QVjirEvUdZddlZddlZddlmZddlmZmZmZm Z ddl Z ddl Z ddl m Z ddlmZmZddlmZdd lmZmZd aejZejZgaeeegdfeefed <e e j!d d Z"e e ee#dfZ$ea%dZ&ee j!j'ed<de(fdZ)e)r%e j!j*Z*e j!j+Z,e j!j-Z.nedZ*de#de#fdZ,de#de#fdZ.edde#fdZ/de(fdZ0d@de(de(fdZ1dZ2dZ3dZ4dZ5Gd d!Z6Gd"dZ Gd#d$e Z7de$ddfd%Z8dAdee$defd&Z9eddAdee$de:eeffd'Z;dAdee$de*fd(ZGd+d,Z?d-ed.de?fd/Z@d0ZAd-efd1ZBdAdee$defd2ZC dAd3e#dee$defd4ZDdAde$ddfd5ZEdeefd6ZFdefd7ZGde j de j!j'fd8ZH dBd:e#de e#ee j fddfd;ZIdBde e#ee j fde#fd<ZJdd=lKmLZLmMZMmNZNmOZOmPZPmQZQmRZRmSZSmTZTmUZUdd>lVmWZWmXZXmYZYmZZZm[Z[m\Z\m]Z]m^Z^m_Z_gd?Z`dS)Cz This package introduces support for the XPU backend, specifically tailored for Intel GPU optimization. This package is lazily initialized, so you can always import it, and use :func:`is_available()` to determine if your system supports XPU. N) lru_cache)AnyCallableOptionalUniondevice) _dummy_type_LazySeedTracker)_get_device_index)EventStreamF _queued_calls_xpu_isInBadForkcdSNFrL/root/voice-cloning/.venv/lib/python3.11/site-packages/torch/xpu/__init__.pyrsrrdefault_generatorsreturnc$tjjS)z(Return true if compile with XPU support.)torch_C_has_xpurrr _is_compiledr$s 8 r_XpuDevicePropertiesr c tdNz(PyTorch was compiled without XPU supportNotImplementedErrorrs r_exchange_devicer$1!"LMMMrc tdr!r"rs r_maybe_exchange_devicer'4r%r)maxsizec^tsdStjS)z*Return the number of XPU device available.r)rrr_xpu_getDeviceCountrrr device_countr+8s) >>q 8 ' ' ) ))rc&tdkS)z7Return a bool indicating if XPU is currently available.r)r+rrr is_availabler-@s >>A rTincluding_emulationcltsdS|p"tjjS)zKReturn a bool indicating if the current XPU device supports dtype bfloat16.F)r-rxpuget_device_propertieshas_bfloat16_conversions)r.s ris_bf16_supportedr3Fs5 >>u F 9 * * , , Erc.tot S)z8Return whether PyTorch's XPU state has been initialized.) _initialized_is_in_bad_forkrrris_initializedr7Ps  1 1 111rc tr |dS|ddr.t|t jdS|ddr.t|t jdSt|t jfdS)Nseed_allFseed) r7get_lazy_seed_trackerqueue_seed_all traceback format_stack queue_seedrappend)callablekwargss r _lazy_callrDUs G  ::j% ( ( G  - -h 8N8P8P Q Q Q Q Q ZZ & & G  ) )(I4J4L4L M M M M M  (I,B,D,D!E F F F F Frc"tdS)zInitialize PyTorch's XPU state. This is a Python API about lazy initialization that avoids initializing XPU until the first time it is accessed. Does nothing if the XPU state is already initialized. N) _lazy_initrrrinitrGcs LLLLLrc 2tsttdrdSt5tr ddddSt rt dt stdtj dt_ t dtD tD]Z\}} |#t $r=}dt#|dd|}t!||d}~wwxYw t'tdn#t'tdwxYwdaddddS#1swxYwYdS) Nis_initializingzuCannot re-initialize XPU in forked subprocess. To use XPU with multiprocessing, you must use the 'spawn' start methodz#Torch not compiled with XPU enabledTc3K|]}||V dSNr).0callss r z_lazy_init..s(XXuRWXUXXXXXXrz5XPU call failed lazily at initialization with error: z' XPU call was originally invoked at: )r7hasattr_tls_initialization_lockr6 RuntimeErrorrAssertionErrorrr _xpu_initrIrextendr< get_calls Exceptionstrjoindelattrr5) queued_callorig_tracebackemsgs rrFrFls074):;; !!      !!!!!!!!    I ~~ H !FGG G  $XX0B0L0L0N0NXXXXXX -/< 0 0+ ^0KMMMM 000\PSTUPVPV\\BD''.BYBY\\$C..a/ 0 0 D+ , , , ,GD+ , , , , C!!!!!!!!!!!!!!!!!!sTF  BF * E#7 DE# E  8EE  E# F #E::F  FFc4eZdZdefdZdZdededefdZdS) _DeviceGuardindexc"||_d|_dSN)idxprev_idx)selfrbs r__init__z_DeviceGuard.__init__s rcXtj|j|_dSrKrr0r$rfrgrhs r __enter__z_DeviceGuard.__enter__ 2248<< rtypevaluer>cXtj|j|_dSrrr0r'rgrfrhrorpr>s r__exit__z_DeviceGuard.__exit__ 933DMBBurN)__name__ __module__ __qualname__intrirmrrtrrrrarasgc===Srrac8eZdZdZdefdZdZdededefdZdS) r zContext-manager that changes the selected device. Args: device (torch.device or int or str): device index to select. It's a no-op if this argument is a negative integer or ``None``. c@t|d|_d|_dS)NToptionalre)r rfrg)rhr s rrizdevice.__init__s!$Vd;;; rcXtj|j|_dSrKrkrls rrmzdevice.__enter__rnrrorpr>cXtj|j|_dSrrrrss rrtzdevice.__exit__rurN)rvrwrx__doc__rrirmrtrrrr r sqs===Src"eZdZdZfdZxZS) device_ofaContext-manager that changes the current device to that of given object. You can use both tensors and storages as arguments. If a given object is not allocated on a XPU, this is a no-op. Args: obj (Tensor or Storage): object allocated on the selected device. c|jr|nd}t|dSrd)is_xpu get_devicesuperri)rhobjrf __class__s rrizdevice_of.__init__s<"%*4cnn" r)rvrwrxrri __classcell__)rs@rrrsBrrctt|}|dkr!tj|dSdS)zSet the current device. Args: device (torch.device or int or str): selected device. This function is a no-op if this argument is negative. rN)rFr rr_xpu_setDevicers r set_devicersFLLL v & &F {{ '''''{rc*t|jS)aGet the name of a device. Args: device (torch.device or int or str, optional): device for which to return the name. This function is a no-op if this argument is a negative integer. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Returns: str: the name of the device )r1namers rget_device_namers ! ( ( --rct|ttttt dt ttffdtDS)aGet the xpu capability of a device. Args: device (torch.device or int or str, optional): device for which to return the device capability. This function is a no-op if this argument is a negative integer. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Returns: Dict[str, Any]: the xpu capability dictionary of the device Nci|]:}|dtt|x7|;S)__) startswith isinstancegetattr)rLkeypropsserializable_typesrps r z)get_device_capability..sa    ~~d##  !4!447I J J   U   r) r1ryfloatboolrYrolisttupledictdir)r rrrps @@@rget_device_capabilityrsl "& ) )EudCdT5$O      u::   rc^tt|d}t|S)zGet the properties of a device. Args: device (torch.device or int or str): device for which to return the properties of the device. Returns: _XpuDeviceProperties: the properties of the device Tr|)rFr _get_device_propertiesrs rr1r1s-LLL v 5 5 5F !& ) ))rcZttjS)z0Return the index of a currently selected device.)rFrr_xpu_getDevicerrrcurrent_devicersLLL 8 " " $ $$rct|trtj|}n*t|trtjd|}|S)zReturn the torch.device type object from the passed in device. Args: device (torch.device or int or str): selected device. r0)rrYrr ryrs r _get_devicersO &#-f%% FC -eV,, Mrc\eZdZUdZeded<dedfdZdZdeded efd Z d S) StreamContextaContext-manager that selects a given stream. All XPU kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.xpu.Stream cur_streamstreamc^||_tdd|_|j d|_dSdS)NTre)rr rf)rhrs rrizStreamContext.__init__)s5 $T400 8 DHHH  rc|j}| |jdkrdStjd|_|jj|jkrUt |j5tj|j|_dddn #1swxYwYtj|dSrd) rrfrr0current_streamsrc_prev_streamr dst_prev_stream set_stream)rhrs rrmzStreamContext.__enter__/s[  R F$y77==   &**; ; ; )** S S',y'?'? @Q'R'R$ S S S S S S S S S S S S S S S Z(((((s$*BB!Brorpr>c|j}| |jdkrdS|jj|jkr$tj|jtj|jdSrd)rrfrr rr0rr)rhrorpr>rs rrtzStreamContext.__exit__;sl[  R F   &**; ; ; I !5 6 6 6 T122222rN) rvrwrxrr__annotations__rirmrrtrrrrrs  +,,,,x(:; ) ) )3S33333333rrrrc t|S)zWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. )rrs rrrFs   rcJtj|||dS)aset stream specified by the stream id, device index and device type Args: stream_id (int): not visible to the user, used to assigned to the specific stream. device_index (int): selected device index. device_type (int): selected device type.  stream_id device_index device_typeN)rr_xpu_setStreamrs r_set_stream_by_idrOs6 H!rcl|dStt|j|j|jdS)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. Nr)rFrrrrrs rrr]sJ~LLL"(&rcttjt |d}t |d|d|dS)aRReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Tr|rr r)rFrr_xpu_getCurrentStreamr r)r streamdatas rrrpsaLLL//&4000J Q-jmTU   rdata_ptrcttj|t |d}t |d|d|dS)a;Return a :class:`Stream` from an external SYCL queue. This function is used to wrap SYCL queue created in other libraries in order to facilitate data exchange and multi-library interactions. .. note:: This function doesn't manage the queue life-cycle, it is the user responsibility to keep the referenced queue alive while this returned stream is being used. The different SYCL queue pointers will result in distinct :class:`Stream` objects, even if the SYCL queues they dereference are equivalent. Args: data_ptr(int): Integer representation of the `sycl::queue*` value passed externally. device(torch.device or int, optional): the device where the queue was originally created. It is the user responsibility to ensure the device is specified correctly. Tr|rr rr)rFrr_xpu_getStreamFromExternalr r)rr rs rget_stream_from_externalrsd$LLL44#FT:::J Q-jmTU   rc~tt|d}tj|S)a*Wait for all kernels in all streams on a XPU device to complete. Args: device (torch.device or int, optional): device for which to synchronize. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Tr|)rFr rr_xpu_synchronizers r synchronizers5LLL v 5 5 5F 8 $ $V , ,,rctsgStj}|gS|S)z> ++--J     rct}t|dkrdSddd|DS)zIReturn XPU AOT(ahead-of-time) build flags this library was compiled with.rrOz-device ,c3K|]}|VdSrKr)rLarchs rrNz$get_gencode_flags..s"::t::::::r)rlenrZ) arch_lists rget_gencode_flagsrsJI 9~~r .cbs+*<88$$V,,,,,rN)rrD)rr rrs` @r_set_rng_state_offsetrsBv&&L------rNNNNNrctt|}t|}|S)aLReturn the random number generator state offset of the specified GPU. Args: device (torch.device or int, optional): The device to return the RNG state offset of. Default: ``'xpu'`` (i.e., ``torch.device('xpu')``, the current XPU device). .. warning:: This function eagerly initializes XPU. )rFrr get_offset)r rrs r_get_rng_state_offsetrs:LLLv&&L&|44  ' ' ) ))r) empty_cachemax_memory_allocatedmax_memory_reserved mem_get_infomemory_allocatedmemory_reserved memory_statsmemory_stats_as_nested_dictreset_accumulated_memory_statsreset_peak_memory_stats) get_rng_stateget_rng_state_all initial_seed manual_seedmanual_seed_allr:r9 set_rng_stateset_rng_state_all)+rrrrrrr rr+rrrrr1rrrrrGrr-r3r7rrrrrrrrrrrr:r9rrrrrstreamsr)TrK)r0)ar threadingr> functoolsrtypingrrrrrtorch._Cr _device torch._utilsr r _utilsr rrrr5localrQLockrRrrrrYrrrr6ry _device_tr<r Generatorrrr_xpu_exchangeDevicer$_xpu_maybeExchangeDevicer'r+r-r3r7rDrGrFrarrrrrr1rrrrrrrrrrrrrrmemoryrrrrrrrrrrrandomrrrrrr:r9rr__all__rrrrsU111111111111 ######66666666%%%%%%"""""""" y%y~''t (2t8 d3i '('%($6 FF '3T) * %%''02E%(,-222d <>> N 88x3"X>';'=>>NNNNNNNsNsNNNN 1*c****d 44222 G G G%%%P        (         (y (T ( ( ( ( . .HY/ .3 . . . . 4(9"5c3h0 * *(9"5 *AU * * * *%%%%% c3 45 %,    (3(3(3(3(3(3(3(3V!8./!M!!!!   v&8I.&&26#I. 6 - - -T - - - -tCy=3==== -5< -EH,> - - - -:? sC56 & * *%S%,(>"? *C * * * *"                                              , , , r