L i RdZddlmZer ddlmZddlmZddlmZdefdZy) zFP-Quant integration file)is_fp_quant_available) FPQuantConfig) FPQuantDtypeconfigc |jdk(rtj}n8|jdk(rtj}nt d|j|j dk(rtj }nt d|j t||j||j|j|j|j|jS)Nmxfp4nvfp4zUnsupported forward dtype: bf16zUnsupported backward dtype: ) forward_dtypeforward_methodbackward_dtypestore_master_weightshadamard_group_sizepseudoquantizationtransform_initmodules_to_not_convert)r rMXFP4NVFP4 ValueErrorrBF16FPQuantLinearConfigr rrrrr)rr rs h/mnt/ssd/data/python-lab/Trading/venv/lib/python3.12/site-packages/transformers/integrations/fp_quant.pyadapt_fp_quant_configrs w&$**    ($** 6v7K7K6LMNN &%**78M8M7NOPP #,,%#88"66!44,,%<<  N) __doc__utilsrfp_quantrrr&transformers.utils.quantization_configrrrr!s, =%@-r