o  h@sDdZddlmZmZmZmZerddlmZ    dddZdS) z?AQLM (Additive Quantization of Language Model) integration file)ACCELERATE_MIN_VERSIONis_accelerate_availableis_aqlm_availableis_torch_availableNFc CsJtstdtstdtd|durg}ddlm}ddlm}|D]x\}}|dur2g}| |t |t j rd |d |vr|5|j} |j} || | |jdu|j|j|j|jd |j|<d }t||j|_|j|d Wdn1swYtt|dkrt|||||d \} }|dq(||fS)ao Public method that recursively replaces the Linear layers of the given model with AQLM quantized layers. `accelerate` is needed to use this method. Returns the converted model and a boolean that indicates if the conversion has been successfull or not. Args: model (`torch.nn.Module`): The model to convert, can be any `torch.nn.Module` instance. quantization_config (`AqlmConfig`): The quantization config object that contains the quantization parameters. linear_weights_not_to_quantize (`list[str]`, *optional*): A list of nn.Linear weights to not convert. If a parameter path is in the list (e.g. `lm_head.weight`), the corresponding module will not be converted. current_key_name (`list`, *optional*): A list that contains the current key name. This is used for recursion and should not be passed by the user. has_been_replaced (`bool`, *optional*): A boolean that indicates if the conversion has been successful or not. This is used for recursion and should not be passed by the user. zIAQLM is not available. Please install it with `pip install aqlm[cpu,gpu]`zDAQLM requires Accelerate to be installed: `pip install 'accelerate>=z'`Nr)init_empty_weights)QuantizedLinear.z.weight)bias in_group_sizeout_group_size num_codebooksnbits_per_codebookTF)quantization_configlinear_weights_not_to_quantizecurrent_key_namehas_been_replaced)r ValueErrorrr accelerateraqlmrnamed_childrenappend isinstancennLinearjoin in_features out_featuresr r r r r_modulestype source_clsrequires_grad_lenlistchildrenreplace_with_aqlm_linearpop) modelrrrrrrnamemodulerr_r,r/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/transformers/integrations/aqlm.pyr&sT        r&)NNNF) __doc__utilsrrrrtorch.nnrr&r,r,r,r-s