L ib UddlZddlmZddlmZmZddlmZddlm Z  ddl m Z m Z m Z mZmZmZmZd Zd e d d id e dd ie dd e j&e dd idd e dd ie j(e dd e j&e dd ie j&e dd idd e j&e j*ze dddiid e j&e j*ze dddiid e j&e j*ze dddiid e j&e j*ze dddiid e j&e j*ze dd diid e j&e j*ze dd!diid" Zeeeee efe ffed#<eed*eed+efd,Zd*ed+dfd-Zgd.Zy#e$rd$Zd%ZGd&d'Z d(Zd)ZY4wxYw)/N)partial)OptionalUnion)lazy_import_flash_attention)flash_attention_forward)DeviceLayerRepositoryMode get_kernelregister_kernel_mappingreplace_kernel_forward_from_hubuse_kernel_forward_from_hubTcudaz!kernels-community/deformable-detrMultiScaleDeformableAttention)repo_id layer_namezkernels-community/moe Llama4TextMoezkernels-community/liger_kernels LigerRMSNorm)rrocmzmedmekk/triton-llama-mlpTritonLlamaMLPzkernels-community/megablocksMegaBlocksMoeMLPzahadnagy/megablockszkernels-community/activationFastGELUz>=0.0.4,<0.1.0)rrversion QuickGELUNewGELUSiluz>=0.1.0GeluGeluTanh) rrRMSNormMLPrrrrSiLUGeLUr _KERNEL_MAPPINGFc d}|S)Nc|S)N)clss k/mnt/ssd/data/python-lab/Trading/venv/lib/python3.12/site-packages/transformers/integrations/hub_kernels.py decoratorz.use_kernel_forward_from_hub..decoratorsJr()argskwargsr+s r*rrs r,ceZdZdZy)r ctd)NzNLayerRepository requires `kernels` to be installed. Run `pip install kernels`. RuntimeError)selfr-r.s r*__init__zLayerRepository.__init__sop pr,N)__name__ __module__ __qualname__r4r(r,r*r r s qr,r ctd)Nz^replace_kernel_forward_from_hub requires `kernels` to be installed. Run `pip install kernels`.r1r-r.s r*rrs l  r,ctd)NzVregister_kernel_mapping requires `kernels` to be installed. Run `pip install kernels`.r1r9s r*rrssttr,attn_implementationreturnc>|duxrtjd|duS)zJCheck whether `attn_implementation` matches a kernel pattern from the hub.Nz'^[^/:]+/[^/:]+(?:@[^/:]+)?(?::[^/:]+)?$)research)r;s r* is_kernelr@s- 4' c II@BU V^b br,ct|syts tdddlm}ddlm}d}|}d|vr%|jd\}}|j|}d|vr%|jd\}}|j}n|}d}|j}|jd\}}}|j}|r|jnd} t|| } t| d r#|t}t!|| } t#| dn| t%| |} |j'| |j'||dy#t$r} td |d | d d} ~ wwxYw)zALoad and register the kernel associated to `attn_implementation`.Nz`kernels` is either not installed or uses an incompatible version. Please install the latest version with `pip install -U kernels`.r)ALL_MASK_ATTENTION_FUNCTIONS)ALL_ATTENTION_FUNCTIONS|:@)revisionz-An error occurred while trying to load from 'z': .flash_attn_varlen_func)implementationT) force_importflash_attention_2)r@_kernels_available ImportError masking_utilsrBmodeling_utilsrCsplitgetstrip partitionr Exception ValueErrorhasattrr rrgetattrregister) r;rBrCattention_wrapperactual_attn_namer kernel_name_revkernelekernel_functions r*load_and_register_kernelrbs ( )  O  =8* !!.A.G.G.L++3778IJ /55c:!'') " mmoG'',OGQmmoG#))+$C[Gc2v/0  $ 7 !"3FK#F>  !&+6$$%8/J ))*=?[\o?pq [H QTUVTWWXYZZ[s E E  EE )r rrr)r> functoolsrtypingrrmodeling_flash_attention_utilsrflash_attentionr kernelsr r r r rrrrM INFERENCETRAINING TORCH_COMPILEr%dictstr__annotations__rNboolr@rb__all__r(r,r*rps "H4Ju O;:*  O/* $9) =-!   O2+  :1 :1! 11! & !3!33_:),6  !3!33_:*,6  !3!33_:(,6  !3!33_:vW`6  !3!33_:vW`6  !3!33_:z[d6 {dMOT#tE&#+$6$GHHIdLO,48C=T1r#1r$1rh iu qq u)usFG G('G(