o s hI @s~ddlZddlZddlmZmZmZddlZddlm Z m Z m Z m Z dej defddZddeeej fd eeeefdefd d Z ddeeej fd eeejfd eeeefddfd dZdedeeej ffddZd eeejfdeeej ffddZejejejejejejejejejejej e!d Z"dedej#fddZ$deeej ffddZ%dej de!fddZ&dS)N)DictOptionalUnion) deserialize safe_open serializeserialize_filetensorreturncCst|s |jdd}|S)NF)inplace)_is_little_endianbyteswaptobytes)r re/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/safetensors/numpy.py_tobytes s r tensor_dictmetadatacCs*dd|D}t||d}t|}|S)a& Saves a dictionary of tensors into raw bytes in safetensors format. Args: tensor_dict (`Dict[str, np.ndarray]`): The incoming tensors. Tensors need to be contiguous and dense. metadata (`Dict[str, str]`, *optional*, defaults to `None`): Optional text only metadata you might want to save in your header. For instance it can be useful to specify more about the underlying tensors. This is purely informative and does not affect tensor loading. Returns: `bytes`: The raw bytes representing the format Example: ```python from safetensors.numpy import save import numpy as np tensors = {"embedding": np.zeros((512, 1024)), "attention": np.zeros((256, 256))} byte_data = save(tensors) ``` cS(i|]\}}||jj|jt|dqS)dtypeshapedatarnamerr.0kvrrr )(zsave..r)itemsrbytes)rr flattened serializedresultrrrsaves r'filenamecCs$dd|D}t|||ddS)aj Saves a dictionary of tensors into raw bytes in safetensors format. Args: tensor_dict (`Dict[str, np.ndarray]`): The incoming tensors. Tensors need to be contiguous and dense. filename (`str`, or `os.PathLike`)): The filename we're saving into. metadata (`Dict[str, str]`, *optional*, defaults to `None`): Optional text only metadata you might want to save in your header. For instance it can be useful to specify more about the underlying tensors. This is purely informative and does not affect tensor loading. Returns: `None` Example: ```python from safetensors.numpy import save_file import numpy as np tensors = {"embedding": np.zeros((512, 1024)), "attention": np.zeros((256, 256))} save_file(tensors, "model.safetensors") ``` cSrrrrrrrrLr zsave_file..r!N)r"r)rr(rr$rrr save_file/sr)rcCst|}t|S)a Loads a safetensors file into numpy format from pure bytes. Args: data (`bytes`): The content of a safetensors file Returns: `Dict[str, np.ndarray]`: dictionary that contains name as key, value as `np.ndarray` on cpu Example: ```python from safetensors.numpy import load file_path = "./my_folder/bert.safetensors" with open(file_path, "rb") as f: data = f.read() loaded = load(data) ``` )r_view2np)rflatrrrloadPsr,cCsRi}t|dd}|D] }||||<q Wd|S1s"wY|S)a Loads a safetensors file into numpy format. Args: filename (`str`, or `os.PathLike`)): The name of the file which contains the tensors Returns: `Dict[str, np.ndarray]`: dictionary that contains name as key, value as `np.ndarray` Example: ```python from safetensors.numpy import load_file file_path = "./my_folder/bert.safetensors" loaded = load_file(file_path) ``` np) frameworkN)rkeys get_tensor)r(r&frrrr load_fileks  r2) F64F32F16I64U64I32U32I16U16I8U8BOOL dtype_strcCst|SN)_TYPES)r?rrr _getdtypesrBcCsFi}|D]\}}t|d}tj|d|d|d}|||<q|S)Nrr)rr)rBr- frombufferreshape)safeviewr&rrrarrrrrr*s    r*cCsT|jj}|dkrtjdkrdSdS|dkrdS|dkrdS|dkr#dStd|) N=littleTF|<>zUnexpected byte order )r byteordersys ValueError)r rLrrrr s r r@)'osrMtypingrrrnumpyr- safetensorsrrrrndarrayr#rstrr'PathLiker)r,r2float64float32float16int64uint64int32uint32int16uint16int8uint8boolrArrBr*r rrrrsF.    !&