o  hn @slddlZddlmZmZddlmZmZmZmZm Z m Z m Z ddl Z ddl mZmZmZddlmZmZmZddlmZerFdd l mZmZeeZerpdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+erdd lm,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4esese5d dd de6dee6dee6eegefffddZ7GdddZ8dS)N)partialreduce) TYPE_CHECKINGCallableDictOptionalTupleTypeUnion)PretrainedConfigis_tf_availableis_torch_available)TF2_WEIGHTS_NAME WEIGHTS_NAMElogging) OnnxConfigPreTrainedModelTFPreTrainedModel) AutoModelAutoModelForCausalLMAutoModelForImageClassificationAutoModelForImageSegmentationAutoModelForMaskedImageModelingAutoModelForMaskedLMAutoModelForMultipleChoiceAutoModelForObjectDetectionAutoModelForQuestionAnswering AutoModelForSemanticSegmentationAutoModelForSeq2SeqLM"AutoModelForSequenceClassificationAutoModelForSpeechSeq2SeqAutoModelForTokenClassificationAutoModelForVision2Seq) TFAutoModelTFAutoModelForCausalLMTFAutoModelForMaskedLMTFAutoModelForMultipleChoiceTFAutoModelForQuestionAnswering"TFAutoModelForSemanticSegmentationTFAutoModelForSeq2SeqLM$TFAutoModelForSequenceClassification!TFAutoModelForTokenClassificationzThe ONNX export features are only supported for PyTorch or TensorFlow. You will not be able to export models without one of these libraries installed.onnx_config_clssupported_featuresr0returncGsz|durtdt}|dD]}t||}qi}|D]}d|vr1|dd}t|j|d||<qt|j|d||<q|S)ac Generate the mapping between supported the features and their corresponding OnnxConfig for a given model. Args: *supported_features: The names of the supported features. onnx_config_cls: The OnnxConfig full name corresponding to the model. Returns: The dictionary mapping a feature to an OnnxConfig constructor. Nz#A OnnxConfig class must be provided. -with-past)task) ValueError transformerssplitgetattrreplacer with_pastfrom_model_config)r0r1 config_cls attr_namemappingfeaturer6rBn/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/transformers/onnx/features.pysupported_features_mapping7s   rDc@sPeZdZiZiZereeee e e e e eeeeeeedZer,eeeeeeeeed Zidedddddd d d d edd dddddd dd dedddd deddddddd dd deddddddd dd dedd dddddd dd dedd dddddd dedd dddddd d edd ddddd!d d"eddddddd d#d d$edd%d d&eddd'd d(edddddd d)d d*eddd+d d,edddddd d-d d.eddd/d d0eddddd d1d id2edddddd d3d d4eddd5d d6edd7d8d9d d:edddddd d;d deddddddd d?d d@edd dddddAd dBedd ddd ddCd dDedd ddddEd dFeddGd dHedddddd dId dJedddKd dLedddddMd dNedd dddOd dPedddQd dRedd dddSd dTedddd dddUd idVedd dddddWd dXedd dddddd dYd dZedddddd d[d d\eddd]d d^eddd_d d`edddad dbedd dddcd ddedd ddded dfeddgd dheddddid djedddkd dleddddddd dmd dnedddod dpeddddddd dqd dreddddddd ddsd dtedddudvd dwedddddd dxd edddyd edd dddzd ed{d|d eddd}d edd d~ddd eddddddd dd eddddddd dd edd7dd dZ e!e"dddde #DZ$e% dde&de'e&de(e&e)e*ge+fffddZ,e%de&de&fddZ-e%de&fddZ.e%dde&de&de/fddZ0e%dde&de'e&de&fddZ1e% dde&de&de'e&de'e&de2df ddZ3e% dde2dde&de4e&e)ffddZ5de&de&de+fddZ6dS)FeaturesManager)default masked-lm causal-lm seq2seq-lmsequence-classificationtoken-classificationmultiple-choiceobject-detectionquestion-answeringimage-classificationimage-segmentationz masked-imsemantic-segmentation vision2seq-lm speech2seq-lm) rFrGrHrIrJrKrLrNrQalbertrFrGrJrLrKrNzmodels.albert.AlbertOnnxConfigr/bartzdefault-with-pastrHzcausal-lm-with-pastrIzseq2seq-lm-with-pastzmodels.bart.BartOnnxConfigbeitrOzmodels.beit.BeitOnnxConfigbertzmodels.bert.BertOnnxConfigzbig-birdz!models.big_bird.BigBirdOnnxConfigzbigbird-pegasusz/models.bigbird_pegasus.BigBirdPegasusOnnxConfig blenderbotz&models.blenderbot.BlenderbotOnnxConfigzblenderbot-smallz1models.blenderbot_small.BlenderbotSmallOnnxConfigbloomzmodels.bloom.BloomOnnxConfig camembertz$models.camembert.CamembertOnnxConfigclipzmodels.clip.CLIPOnnxConfigcodegenz models.codegen.CodeGenOnnxConfigconvbertz"models.convbert.ConvBertOnnxConfigconvnextz"models.convnext.ConvNextOnnxConfigz data2vec-textz&models.data2vec.Data2VecTextOnnxConfigzdata2vec-visionz(models.data2vec.Data2VecVisionOnnxConfigdebertaz models.deberta.DebertaOnnxConfigz deberta-v2z%models.deberta_v2.DebertaV2OnnxConfigdeitzmodels.deit.DeiTOnnxConfigdetrrMrPzmodels.detr.DetrOnnxConfig distilbertz&models.distilbert.DistilBertOnnxConfigelectraz models.electra.ElectraOnnxConfigflaubertz"models.flaubert.FlaubertOnnxConfiggpt2zmodels.gpt2.GPT2OnnxConfiggptjzmodels.gptj.GPTJOnnxConfigzgpt-neozmodels.gpt_neo.GPTNeoOnnxConfiggroupvitz"models.groupvit.GroupViTOnnxConfigibertzmodels.ibert.IBertOnnxConfigimagegptz"models.imagegpt.ImageGPTOnnxConfiglayoutlmz"models.layoutlm.LayoutLMOnnxConfig layoutlmv3z&models.layoutlmv3.LayoutLMv3OnnxConfiglevitzmodels.levit.LevitOnnxConfiglongt5zmodels.longt5.LongT5OnnxConfig longformerz&models.longformer.LongformerOnnxConfigmarianzmodels.marian.MarianOnnxConfigmbartzmodels.mbart.MBartOnnxConfig mobilebertz&models.mobilebert.MobileBertOnnxConfigz mobilenet-v1z)models.mobilenet_v1.MobileNetV1OnnxConfigz mobilenet-v2z)models.mobilenet_v2.MobileNetV2OnnxConfig mobilevitz$models.mobilevit.MobileViTOnnxConfigmt5zmodels.mt5.MT5OnnxConfigzm2m-100zmodels.m2m_100.M2M100OnnxConfigowlvitzmodels.owlvit.OwlViTOnnxConfig perceiverz$models.perceiver.PerceiverOnnxConfig poolformerz&models.poolformer.PoolFormerOnnxConfigrembertz models.rembert.RemBertOnnxConfigresnetzmodels.resnet.ResNetOnnxConfigrobertaz models.roberta.RobertaOnnxConfigroformerz"models.roformer.RoFormerOnnxConfig segformerrQz$models.segformer.SegformerOnnxConfig squeezebertz(models.squeezebert.SqueezeBertOnnxConfigzmodels.swin.SwinOnnxConfigzmodels.t5.T5OnnxConfigrRz*szFeaturesManager.ccs|]}|VqdSr)keys).0vrBrBrC *szFeaturesManager.N model_type model_namer2cCsX|}|tjvr'|r|d|dn|}t|dttjd|dtj|S)a Tries to retrieve the feature -> OnnxConfig constructor map from the model type. Args: model_type (`str`): The model type to retrieve the supported features for. model_name (`str`, *optional*): The name attribute of the model object, only used for the exception message. Returns: The dictionary mapping each feature to a corresponding OnnxConfig constructor. z ()z is not supported yet. Only z' are supported. If you want to support z) please propose a PR or open up an issue.)lowerrE_SUPPORTED_MODEL_TYPEKeyErrorlistr)rrmodel_type_and_model_namerBrBrC%get_supported_features_for_model_type,s   z5FeaturesManager.get_supported_features_for_model_typerAcCs |ddS)Nr4r5)r;)rArBrBrCfeature_to_taskFs zFeaturesManager.feature_to_task frameworkcCsL|dvr td|d|dkrtstd|dkr"ts$tddSdS) z Validates if the framework requested for the export is both correct and available, otherwise throws an exception. pttfzAOnly two frameworks are supported for ONNX export: pt or tf, but z was provided.rzOCannot export model to ONNX using PyTorch because no PyTorch package was found.rzUCannot export model to ONNX using TensorFlow because no TensorFlow package was found.N)r7r RuntimeErrorr )rrBrBrC_validate_framework_choiceJs z*FeaturesManager._validate_framework_choicercCsXt|}t||dkrtj}ntj}||vr(td|dttj||S)ad Attempts to retrieve an AutoModel class from a feature name. Args: feature (`str`): The feature required. framework (`str`, *optional*, defaults to `"pt"`): The framework to use for the export. Returns: The AutoModel class corresponding to the feature. rzUnknown task: z. Possible values are )rErr_TASKS_TO_AUTOMODELS_TASKS_TO_TF_AUTOMODELSrrvalues)rArr6task_to_automodelrBrBrCget_model_class_for_featureYs  z+FeaturesManager.get_model_class_for_featuremodelcCs|dur|Sddd}ddd}tj|rItjtj|tr$d}ntjtj|tr2d}n td td td t d ||d nt rOd}n t rUd}nt dt d||d|S)a Determines the framework to use for the export. The priority is in the following order: 1. User input via `framework`. 2. If local checkpoint is provided, use the same framework as the checkpoint. 3. Available framework in environment, with priority given to PyTorch Args: model (`str`): The name of the model to export. framework (`str`, *optional*, defaults to `None`): The framework to use for the export. See above for priority if none provided. Returns: The framework to use for the export. NPyTorch TensorFlowrtorchtf2onnxrrzMCannot determine framework from given checkpoint location. There should be a z for PyTorch or z for TensorFlow.zLocal z model found.zKNeither PyTorch nor TensorFlow found in environment. Cannot export to ONNX.zFramework not requested. Using z to export to ONNX.) ospathisdirisfilejoinrrFileNotFoundErrorloggerinforr EnvironmentError)rr framework_map exporter_maprBrBrCdetermine_frameworkts0   z#FeaturesManager.determine_framework cache_dirrcCst||}t||}z |j||d}W|StyA|dkr1td|j|d|d}Y|Std|j|d|d}Y|Sw)a Attempts to retrieve a model from a model's name and the feature to be enabled. Args: feature (`str`): The feature required. model (`str`): The name of the model to export. framework (`str`, *optional*, defaults to `None`): The framework to use for the export. See `FeaturesManager.determine_framework` for the priority should none be provided. Returns: The instance of the model. )rrz=Loading TensorFlow model in PyTorch before exporting to ONNX.T)from_tfrz=Loading PyTorch model in TensorFlow before exporting to ONNX.)from_ptr)rErrfrom_pretrainedOSErrorrr)rArrr model_classrBrBrCget_model_from_features     z&FeaturesManager.get_model_from_featurecCsd|jjdd}t|dd}tj||d}||vr't|jjd|d||jjtj||fS)aR Check whether or not the model has the requested features. Args: model: The model to export. feature: The name of the feature to check if it is available. Returns: (str) The type of the model (OnnxConfig) The OnnxConfig instance holding the model export properties. _-namer5)rz doesn't support feature z. Supported values are: )configrr;r:rErr7r)rrArrmodel_featuresrBrBrCcheck_supported_model_or_raises z.FeaturesManager.check_supported_model_or_raisecCstj||S)aU Gets the OnnxConfig for a model_type and feature combination. Args: model_type (`str`): The model type to retrieve the config for. feature (`str`): The feature to retrieve the config for. Returns: `OnnxConfig`: config for the combination )rEr)rrArBrBrC get_configs zFeaturesManager.get_configr)r)NN)rF)7__name__ __module__ __qualname__rrrrrrr!r"r$rrrrrrr r%r#r r&r(r'r,r-r.r)r*r+rDrsortedrrAVAILABLE_FEATURES staticmethodstrrrrr rrrrr rrr rrrrrBrBrBrCrEUs4  #-8AJS]afot} (2<ENVZcfmtw~%*/4;BFLOY^hsy   5 1    rE)9r functoolsrrtypingrrrrrr r r8r5r r rutilsrrrrrrr get_loggerrrtransformers.models.autorrrrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.warningrrDrErBrBrBrCs6$  D,