o  hI@sFddlZddlZddlZddlmZmZddlmZddlm Z m Z m Z m Z m Z mZmZmZmZmZddlZddlmZddlmZmZmZmZdd lmZmZmZe rldd lm Z dd l!m"Z"dd l#m$Z$dd l%m&Z&eruddl'm(Z(e)e*Z+dZ,dZ-ej.GdddZ/GdddeZ0Gddde0eZ1Gddde1Z2dS)N)ABCabstractmethod) OrderedDict) TYPE_CHECKINGAnyCallableDictIterableListMappingOptionalTupleUnion)version) TensorTypeis_torch_availableis_vision_availablelogging)ParameterFormat compute_effective_axis_dimension"compute_serialized_parameters_size)PretrainedConfigFeatureExtractionMixinImageProcessingMixinPreTrainedTokenizerBase)Image lc@sJeZdZUdZeed<eed<eed<dZe eed<dZ e eed<dS) PatchingSpeca Data class that holds patching specifications. Args: o: Module / object where the op to patch is located name: Name of the op to monkey patch custom_op: Custom op that patches the original op orig_op: Original op that is being patched op_wrapper: Wrapper (optional) that wraps both the original and custom ops. It is useful for ops that are class or static methods for instance. oname custom_opNorig_op op_wrapper) __name__ __module__ __qualname____doc__r__annotations__strrr&r r'r.r.l/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/transformers/onnx/config.pyr"/s  r"c@s`eZdZdZdZdZdZedZ e dddd ie d ddd ie dddd ie ddd ddd ddd d e dddd ie dddd ie dd diie ddd ddd d e ddd ddd de ddddddie dddd ie dd diie dddd ie dddd ie dddd idZ d\ddde de efddZed]ddde ddfddZeedee eee fffd d!Zedee eee fffd"d#Zedeee effd$d%Zedefd&d'Zedefd(d)Zedefd*d+Zedefd,d-Zedefd.d/Z ede!fd0d1Z"e#d2ede!fd3d4Z$ 6d^d7ed8ed9ed:efd;d<Z% ?d_d7ed@edAedBefdCdDZ& E E E F  5 6 6 = > ? d`dGe'dHd7edIedJedKe!dLee(d8ed:ed9ed@edAedBedMedNdee effdOdPZ)dQee efdee effdRdSZ*dTdUZ+dVdWZ,edXe dYe-ede.e effdZd[Z/dS)a OnnxConfigzv Base class for ONNX exportable model describing metadata on how to export the model through the ONNX format. rz1.8logitsbatchsequencerrlast_hidden_state)r3 pred_boxes pred_masksr)r3r8) start_logits end_logits num_labelsheightwidth)rrrdecoder_sequence)z causal-lmdefaultzimage-classificationzimage-segmentationz masked-imz masked-lmmultiple-choicezobject-detectionzquestion-answeringzsemantic-segmentationz seq2seq-lmzsequence-classificationztoken-classificationz vision2seq-lmz speech2seq-lmrANconfigrtaskpatching_specscCs||_||jvrt|d|j||_g|_|dur |ngD]}|}|jdur7tj|t |j |j d}|j |q"dS)Nz+ is not a supported task, supported tasks: )r&) _config_tasks_to_common_outputs ValueErrorkeysrD_patching_specsr& dataclassesreplacegetattrr#r$append)selfrCrDrEspec final_specr.r.r/__init__os  zOnnxConfig.__init__returncCs |||dS)z Instantiate a OnnxConfig for a specific model Args: config: The model's configuration to use when exporting to ONNX Returns: OnnxConfig for this model )rDr.clsrCrDr.r.r/from_model_configs zOnnxConfig.from_model_configcCst)z Mapping containing the axis definition of the input tensors to provide to the model Returns: For each input: its name associated to the axes symbolic name and the axis position within the tensor )NotImplementedErrorrOr.r.r/inputs zOnnxConfig.inputscCs|j|j}t|S)z Mapping containing the axis definition of the output tensors to provide to the model Returns: For each output: its name associated to the axes symbolic name and the axis position within the tensor )rGrDcopydeepcopyrOcommon_outputsr.r.r/outputss  zOnnxConfig.outputscCst|jdr ddiSdS)z Dictionary of keys to override in the model's config before exporting Returns: Dictionary with the keys (and their corresponding values) to override use_cacheFN)hasattrrFrXr.r.r/values_overrides zOnnxConfig.values_overridecCtjS)zp The default batch size to use if no other indication Returns: Integer > 0 )r0default_fixed_batchrXr.r.r/default_batch_sizerZzOnnxConfig.default_batch_sizecCrc)zu The default sequence length to use if no other indication Returns: Integer > 0 )r0default_fixed_sequencerXr.r.r/default_sequence_lengthz"OnnxConfig.default_sequence_lengthcCrc)zw The default number of choices to use if no other indication Returns: Integer > 0 )r0default_fixed_num_choicesrXr.r.r/default_num_choicesrhzOnnxConfig.default_num_choicescCstS)z{ Which onnx opset to use when exporting the model Returns: Integer ONNX Opset version )DEFAULT_ONNX_OPSETrXr.r.r/default_onnx_opsetzOnnxConfig.default_onnx_opsetcCsdS)z What absolute tolerance value to use during model conversion validation. Returns: Float absolute tolerance value. gh㈵>r.rXr.r.r/atol_for_validationrmzOnnxConfig.atol_for_validationcCs(trddlm}t||jkSdS)z The minimum PyTorch version required to export the model. Returns: `bool`: Whether the installed version of PyTorch is compatible with the model. r)get_torch_versionF)rtransformers.utilsrorparsetorch_onnx_minimum_version)rOror.r.r/is_torch_support_availables z%OnnxConfig.is_torch_support_availablenum_parameterscCst|tjtkS)a Flag indicating if the model requires using external data format Args: num_parameters: Number of parameter on the model Returns: True if model.num_parameters() * size_of(float32) >= 2Gb False otherwise )rrFloatEXTERNAL_DATA_FORMAT_SIZE_LIMIT)rtr.r.r/use_external_data_formats z#OnnxConfig.use_external_data_formatr?( batch_size num_channels image_height image_widthcCsFg}t|D]}tj|||d}|t|ddq|S)Nuint8RGB) rangenprandomrandrNr fromarrayastypeconvert)rOryrzr{r|images_datar.r.r/_generate_dummy_imagess  z!OnnxConfig._generate_dummy_images"V@ sampling_rate time_duration frequencycCsRg}t|D] }tjd|t||dd}|dtdtj||q|S)NrF)endpointg?r)rrlinspaceintrNsinpi)rOryrrr audio_datartr.r.r/_generate_dummy_audio s  $z OnnxConfig._generate_dummy_audioF preprocessor)rrr seq_length num_choicesis_pair framework tokenizerrcsLddlm}ddlm}ddlm}t||r| durtd| dur0t dt t d| }t||rt |tjd d }||}t |tj|d }|jdurYt|jd krY|jnd }d |g|g|}|jd krt tjd d |}|||d}|D]\}fddtd tD||<qt|j|dSt|||dSt||r|jd dkrtd|jjd|jd t |tjd}|||| |}t|||dSt||r|jd dkrt |tjd}|||| |}t|||dSt||r"|jd dkr"t |tjd}||| | | }t|||dStd)am Generate inputs to provide to the ONNX exporter for the specific framework Args: preprocessor: ([`PreTrainedTokenizerBase`], [`FeatureExtractionMixin`], or [`ImageProcessingMixin`]): The preprocessor associated with this model configuration. batch_size (`int`, *optional*, defaults to -1): The batch size to export the model for (-1 means dynamic axis). num_choices (`int`, *optional*, defaults to -1): The number of candidate answers provided for multiple choice task (-1 means dynamic axis). seq_length (`int`, *optional*, defaults to -1): The sequence length to export the model for (-1 means dynamic axis). is_pair (`bool`, *optional*, defaults to `False`): Indicate if the input is a pair (sentence 1, sentence 2) framework (`TensorType`, *optional*, defaults to `None`): The framework (PyTorch or TensorFlow) that the tokenizer will generate tensors for. num_channels (`int`, *optional*, defaults to 3): The number of channels of the generated images. image_width (`int`, *optional*, defaults to 40): The width of the generated images. image_height (`int`, *optional*, defaults to 40): The height of the generated images. sampling_rate (`int`, *optional* defaults to 22050) The sampling rate for audio data generation. time_duration (`float`, *optional* defaults to 5.0) Total seconds of sampling for audio data generation. frequency (`int`, *optional* defaults to 220) The desired natural frequency of generated audio. Returns: Mapping[str, Tensor] holding the kwargs to provide to the model's forward function rrrrNzPYou cannot provide both a tokenizer and a preprocessor to generate dummy inputs.ztThe `tokenizer` argument is deprecated and will be removed in version 5 of Transformers. Use `preprocessor` instead.zROverwriting the `preprocessor` argument with `tokenizer` to generate dummy inputs.r)fixed_dimensionnum_token_to_add0 rB) text_paircsg|] }||qSr.r.).0irvr.r/ rz4OnnxConfig.generate_dummy_inputs..) tensor_type)return_tensors pixel_valuesz*The `preprocessor` is an image processor (zC) and expects `model_input_names[0]` to be "pixel_values", but got )r)rrinput_featuresz\Unable to generate dummy inputs for the model. Please provide a tokenizer or a preprocessor.) feature_extraction_utilsrimage_processing_utilsrtokenization_utils_baser isinstancerHwarningswarn FutureWarningloggerwarningrr0rdnum_special_tokens_to_addrf unk_tokenlenjoinrDriitemsrdictconvert_to_tensorsmodel_input_names __class__r(rr)rOrryrrrrrzr|r{rrrrrrr token_to_add input_token dummy_inputtokenized_inputkr.rr/generate_dummy_inputsst 0       &  z OnnxConfig.generate_dummy_inputsreference_model_inputscCs|S)a Generate inputs for ONNX Runtime using the reference model inputs. Override this to run inference with seq2seq models which have the encoder and decoder exported as separate ONNX files. Args: reference_model_inputs ([`Mapping[str, Tensor]`): Reference inputs for the model. Returns: `Mapping[str, Tensor]`: The mapping holding the kwargs to provide to the model's forward function r.)rOrr.r.r/!generate_dummy_inputs_onnxruntimes z,OnnxConfig.generate_dummy_inputs_onnxruntimecC<|jD]}|jdur |jn||j}t|j|j|qdSN)rJr'r%setattrr#r$)rOrPr%r.r.r/ patch_ops zOnnxConfig.patch_opscCrr)rJr'r&rr#r$)rOrPr&r.r.r/ restore_opsrzOnnxConfig.restore_opsr$fieldcs(ddlm}fddt||DS)a Flatten any potential nested structure expanding the name of the field with the index of the element within the structure. Args: name: The name of the nested structure field: The structure to, potentially, be flattened Returns: (Dict[str, Any]): Outputs with flattened structure and key mapping this new structure. r)chaincs i|] \}}d||qS).r.)ridxitemr$r.r/ s zAOnnxConfig.flatten_output_collection_property..) itertoolsr enumerate from_iterable)rUr$rrr.rr/"flatten_output_collection_propertys z-OnnxConfig.flatten_output_collection_property)rANrA)rr?rxrx)rrrr) rrrFNr?rxrxrrrN)0r(r)r*r+rdrfrirrqrrrrGr-r r"rR classmethodrVpropertyrr rrYr_r rrbrergrjrlfloatrnboolrs staticmethodrwrrrrrrrrr rrr.r.r.r/r0Ds " "                  "x(r0csVeZdZ   d*dddedeeedeffd d Ze d+ddded dfd d Z e d e ee e effffdd Ze d ee eeffddZe d e fddZe d e fddZ    d,ddde de dedeed e eeff fdd Z d-de ee e effd ed!efd"d#Zd$d%Zd&ed'eed eeefffd(d) ZZS).OnnxConfigWithPastrANFrCrrDrEuse_pastcstj|||d||_dS)N)rDrE)superrRr)rOrCrDrErrr.r/rRs zOnnxConfigWithPast.__init__rScCs|||ddS)z Instantiate a OnnxConfig with `use_past` attribute set to True Args: config: The underlying model's config to use when exporting to ONNX Returns: OnnxConfig with `.use_past = True` T)rDrr.rTr.r.r/ with_pasts zOnnxConfigWithPast.with_pastcs tj}|jr|j|dd|S)Nr_ direction)rr_rfill_with_past_key_values_r]rr.r/r_szOnnxConfigWithPast.outputscCst|jdr d|jiSdS)Nr`)rarFrrXr.r.r/rbs  z"OnnxConfigWithPast.values_overridecCt|jds td|jjS)z The number of layers attribute retrieved from the model config. Override this for model configs where the number of layers attribute is not called `num_layers`. num_layerszcould not find the number of layers attribute in the model configuration, override the num_layers property of the model OnnxConfig to solve this)rarFAttributeErrorrrXr.r.r/r zOnnxConfigWithPast.num_layerscCr)z The number of attention heads attribute retrieved from the model config. Override this for model configs where the number of attention heads attribute is not called `num_attention_heads`. num_attention_headszcould not find the number of attention heads attribute in the model configuration, override the num_attention_heads property of the model OnnxConfig to solve this)rarFrrrXr.r.r/rrz&OnnxConfigWithPast.num_attention_headsrrrryrrrcstj|||||d}|jrgtstdddl}|dj\}} | d} ||j| |jj |jf} d|vrL|dj } |j |d|j || | dgdd |d<g|d <t |jD]} |d || || fqU|S) NryrrrACannot generate dummy past_keys inputs without PyTorch installed.r input_idsrattention_mask)dtyper)dimpast_key_values)rrrrrHtorchshaperrF hidden_sizercatonesrrrNzeros)rOrryrrr common_inputsrr4seqlenpast_key_values_lengthr mask_dtyperrr.r/rs0     z(OnnxConfigWithPast.generate_dummy_inputsinputs_or_outputsrinverted_values_shapecCs|dvr td|d|dkrdnd}t|jD],}ddd ||d |d <|r8ddd ||d |d <qddd ||d |d <qdS)a Fill the input_or_outputs mapping with past_key_values dynamic axes considering. Args: inputs_or_outputs: The mapping to fill. direction: either "inputs" or "outputs", it specifies whether input_or_outputs is the input mapping or the output mapping, this is important for axes naming. inverted_values_shape: If `True`, store values on dynamic axis 1, else on axis 2. rYr_4direction must either be "inputs" or "outputs", but was givenrYrpresentr4zpast_sequence + sequencerrr.keyr6.valueN)rHrr)rOrrrr$rr.r.r/r&sz-OnnxConfigWithPast.fill_with_past_key_values_cCs4|d||d|d<|d||d|d<dS)Nrrrrrr.rOflattened_outputr$rrr.r.r/_flatten_past_key_values_?sz,OnnxConfigWithPast._flatten_past_key_values_r$rcsDi}|dvrt|D] \}}|||||q |St||}|S)N)rr)rr rr)rOr$rrrrrr.r/rCsz5OnnxConfigWithPast.flatten_output_collection_property)rANFrrrFN)F)r(r)r*r-r listr"rrRrrrr rr_rrbrrrrrr r rr __classcell__r.r.rr/rsd   $  + .rcseZdZedeeeeeffffdd Zedeeffdd Z edeeffdd Z   dd e d d edede de e deeeff fdd ZdeeeeeffdefddZddZZS)OnnxSeq2SeqConfigWithPastrScsrtt|j}|D]"\}}d|vrdnd}|D]\}}d|vr'|||<q|||<qq |jr7|j|dd|S)Nencoderencoder_sequencer@r5r_r)rrr_rrr)rOr^r$ axes_names sequence_nameaxis_idxrr.r/r_Os   z!OnnxSeq2SeqConfigWithPast.outputsc\z tj}||f}W|Sty-t|jdr)t|jdr)|jj|jjf}Y|Stdw)Nencoder_layersdecoder_layerszcould not find the number of encoder and decoder layers attributes in the model configuration, override the num_layers property of the model OnnxConfig to solve this)rrrrarFrr)rOrrr.r/r`  z$OnnxSeq2SeqConfigWithPast.num_layerscr)Nencoder_attention_headsdecoder_attention_headszcould not find the number of attention heads for the encoder and the decoder attributes in the model configuration, override the num_attention_heads property of the model OnnxConfig to solve this)rrrrarFrr)rOrrr.r/rprz-OnnxSeq2SeqConfigWithPast.num_attention_headsrFNrrryrrrc stt|j|||||d}|js|nd}tt|j|||||d}dd|D}td i||} |jrts=tdddl} | dj d} | dj d} | dj d}|j \} }| | | |j j | f}| ||d |j j |f}g| d <|j \}}t||}t|||}||krd nd }t|D]}| d | || || || |fq|d kr|n|}t||D]}| d | || |fq| S)NrrcSsi|] \}}d||qS)decoder_r.)rr$tensorr.r.r/rrzCOnnxSeq2SeqConfigWithPast.generate_dummy_inputs..rrrdecoder_input_idsr?rrdecoderr.)rrrrrrrrHrrrrFrrminmaxrrNr)rOrryrrrencoder_inputsdecoder_seq_lengthdecoder_inputsrrr4encoder_seq_lengthnum_encoder_attention_headsnum_decoder_attention_heads encoder_shape decoder_shapenum_encoder_layersnum_decoder_layersmin_num_layersmax_num_layersremaining_side_namerrrr.r/rsX            z/OnnxSeq2SeqConfigWithPast.generate_dummy_inputsrrc Cs0|dvr td|d|dkrdnd}|j\}}t||}t|||}||kr+dnd}d } |dkr5d nd } t|D]6} d | d ||d| d<d | d ||d| d<d | d ||d| d<d | d ||d| d<q;t||D]} |dkrd | d } nd | d } | ||d| d|d<qwdS)NrrrrYrrrrpast_encoder_sequencepast_decoder_sequencez past_decoder_sequence + sequencer4rr .decoder.key.decoder.value .encoder.key.encoder.valuer)rHrrrr) rOrrr$r'r(r)r*r+rr@r axes_infor.r.r/rs(     z4OnnxSeq2SeqConfigWithPast.fill_with_past_key_values_cCsd|d||d|d<|d||d|d<|d||d|d<|d||d|d <dS) Nrrr.rr/rr0r?r1r.rr.r.r/r sz3OnnxSeq2SeqConfigWithPast._flatten_past_key_values_r )r(r)r*rr r-rr_r rrr rrrrrr r r.r.rr/r Ns4$ "Er )3r[rKrabcrr collectionsrtypingrrrrr r r r r rnumpyr packagingrutilsrrrrrrrconfiguration_utilsrrrrrrrPILr get_loggerr(rrkrv dataclassr"r0rr r.r.r.r/s8  0       y