o  h@spddlmZddlmZmZmZmZddlmZddl m Z e e Z defdd Zd d ZGd d d e ZdS))ArgumentParser)PipelinePipelineDataFormatget_supported_taskspipeline)logging)BaseTransformersCLICommandpathcCs<|sdStjD] }||r|Sqtd|dtj)Npipez4Unable to determine file format from file extension z-. Please provide the format through --format )rSUPPORTED_FORMATSendswith Exception)r extrm/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/transformers/commands/run.pytry_infer_format_from_exts  rcCsrt|j|jr |jnd|j|j|jd}|jdkrt|jn|j}t j ||j |j|j r-|j n|j |jd}t||S)N)taskmodelconfig tokenizerdeviceinfer)format output_path input_pathcolumn overwrite)rrrrrrrrinputrfrom_stroutputrdefault_input_namesr RunCommand)argsnlprreaderrrrrun_command_factory's  r'c@s8eZdZdedefddZedefddZdd Z d S) r#r%r&cCs||_||_dS)N)_nlp_reader)selfr%r&rrr__init__;s zRunCommand.__init__parsercCs|jddd}|jdtdd|jdtdd |jd td d |jd td d |jdtdd |jdtdd |jdtdd |jdtdtjdd|jdtddd|jdddd|jtd dS)!NrunzRun a pipeline through the CLI)helpz--taskz Task to run)choicesr.z--inputz%Path to the file to use for inference)typer.z--outputz9Path to the file that will be used post to write results.z--modelz)Name or path to the model to instantiate.z--configz2Name or path to the model's config to instantiate.z --tokenizerz?Name of the tokenizer to use. (default: same as the model name)z--columnzXName of the column to use as input. (For multi columns input as QA use column1,columns2)z--formatrzInput format to read from)r0defaultr/r.z--devicezSIndicate the device to run onto, -1 indicates CPU, >= 0 indicates GPU (default: -1))r0r1r.z --overwrite store_truez"Allow overwriting the output file.)actionr.)func) add_parser add_argumentrstrrr int set_defaultsr')r, run_parserrrrregister_subcommand?s:zRunCommand.register_subcommandcCs|jg}}|jD] }|jjr|di|n||}t|tr%||q ||7}q |jjr>|j|}t d|dS|j |dS)NzCCurrent pipeline requires output to be in binary format, saving at r) r(r)is_multi_columns isinstancedictappend binary_output save_binaryloggerwarningsave)r*r%outputsentryr! binary_pathrrrr-_s      zRunCommand.runN) __name__ __module__ __qualname__rrr+ staticmethodrr<r-rrrrr#:s  r#N)argparser pipelinesrrrrutilsrr get_loggerrIrCr8rr'r#rrrrs