o  h) @sddlmZmZddlmZddlmZmZmZer$ddl m Z m Z m Z GdddeZ dded ed ed efd d Zdede d efddZded eedfddZdS))c_floatsizeof)Enum) TYPE_CHECKINGOptionalUnionAutoFeatureExtractor AutoProcessor AutoTokenizerc@s"eZdZeZedefddZdS)ParameterFormatreturncCs t|jS)zf Number of byte required for this data type Returns: Integer > 0 )rvalue)selfrk/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/transformers/onnx/utils.pysizes zParameterFormat.sizeN)__name__ __module__ __qualname__rFloatpropertyintrrrrrr sr dimensionfixed_dimensionnum_token_to_addrcCs|dkr|}||8}|S)ze Args: dimension: fixed_dimension: num_token_to_add: Returns: rr)rrrrrr compute_effective_axis_dimension&s rnum_parametersdtypecCs ||jS)a7 Compute the size taken by all the parameters in the given the storage format when serializing the model Args: num_parameters: Number of parameters to be saved dtype: The data format each parameter will be saved Returns: Size (in byte) taken to save all the parameters )r)rrrrr"compute_serialized_parameters_size9s r model_name)r r r c Csddlm}m}m}z||WStttfykd\}}z||}Wn ttfy0Ynwz||}Wn ttfyCYnw|durT|durTtd|d|dur_|dur_YdS|durg|YS|YSw)a> Gets a preprocessor (tokenizer, feature extractor or processor) that is available for `model_name`. Args: model_name (`str`): Name of the model for which a preprocessor are loaded. Returns: `Optional[Union[AutoTokenizer, AutoFeatureExtractor, AutoProcessor]]`: If a processor is found, it is returned. Otherwise, if a tokenizer or a feature extractor exists, it is returned. If both a tokenizer and a feature extractor exist, an error is raised. The function returns `None` if no preprocessor is found. rr )NNNz&Couldn't auto-detect preprocessor for z1. Found both a tokenizer and a feature extractor.)r r r from_pretrained ValueErrorOSErrorKeyError)r!r r r tokenizerfeature_extractorrrrget_preprocessorGs2  r)N)r)ctypesrrenumrtypingrrrr"r r r r rrr strr)rrrrs