~L iUdZddlmZddlmZddlmZdaeeje d<da eeje d<deejfd Z deejfd Z y) au Manages process groups for distributed compilation in TorchDynamo. This module handles the initialization and management of process groups used for distributed compilation. Key features: - Lazy initialization of compilation process groups - Only creates groups when distributed mode is enabled and available - Integrates with compiler_collectives configuration setting - Provides a single global process group for compilation coordination The process group is created only when needed and if the distributed environment is properly initialized, making it safe to import and use this module even in non-distributed scenarios. )OptionalN)config _COMPILE_PG _GUARD_PGreturnctjrTtjr@tjr,t tj jdat Sy)Npt2_compile_pgpg_tag)renable_compiler_collectivesdist is_availableis_initializedrdistributed_c10d_new_group_with_tag_/mnt/ssd/data/python-lab/Trading/venv/lib/python3.12/site-packages/torch/_dynamo/distributed.pyget_compile_pgrsU**        !  //CC'DK rctjr@tjr,t tjj datSy)N pt2_guard_pgr )rrrrrrrrr get_guard_pgr/sA t224  --AAAXI r)__doc__typingrtorch.distributed distributedrrr ProcessGroup__annotations__rrrrrrr!so  ,0 Xd'' (/)- 8D%% &-!2!23&ht001r