%Vji%dZddlmZddlmZddlZddlmZmZddl m Z m Z m Z m Z mZmZmZmZgdZd efd Zd efd Zdd ed eejfdZd efdZedeeZde_ded dfdZedeeZde_dded ejfdZdejd dfdZ dded dfdZ!GddZ"dS)z] This package introduces support for the current :ref:`accelerator` in python. )Optional) deprecatedN) _device_t_get_device_index) empty_cachemax_memory_allocatedmax_memory_reservedmemory_allocatedmemory_reserved memory_statsreset_accumulated_memory_statsreset_peak_memory_stats)current_acceleratorcurrent_device_idxcurrent_device_indexcurrent_streamr device_count device_index is_availabler r r r r rrset_device_idxset_device_index set_stream synchronizereturncvt}|dStj|}|S)aReturn the number of current :ref:`accelerator` available. Returns: int: the number of the current :ref:`accelerator` available. If there is no available accelerators, return 0. .. note:: This API delegates to the device-specific version of `device_count`. On CUDA, this API will NOT poison fork if NVML discovery succeeds. Otherwise, it will. For more details, see :ref:`multiprocessing-poison-fork-note`. Nr)rtorchget_device_moduleraccmods T/root/voice-cloning/.venv/lib/python3.11/site-packages/torch/accelerator/__init__.pyrr.s;   C {q  !# & &C     cvt}|dStj|}|S)aCheck if the current accelerator is available at runtime: it was build, all the required drivers are available and at least one device is visible. See :ref:`accelerator` for details. Returns: bool: A boolean indicating if there is an available :ref:`accelerator`. .. note:: This API delegates to the device-specific version of `is_available`. On CUDA, when the environment variable ``PYTORCH_NVML_BASED_CUDA_CHECK=1`` is set, this function will NOT poison fork. Otherwise, it will. For more details, see :ref:`multiprocessing-poison-fork-note`. Example:: >>> assert torch.accelerator.is_available() "No available accelerators detected." NF)rrrrrs r"rrAs;*   C {u  !# & &C     r#Fcheck_availablecntjx}|r|rtr|SdS)aJReturn the device of the accelerator available at compilation time. If no accelerator were available at compilation time, returns None. See :ref:`accelerator` for details. Args: check_available (bool, optional): if True, will also do a runtime check to see if the device :func:`torch.accelerator.is_available` on top of the compile-time check. Default: ``False`` Returns: torch.device: return the current accelerator as :class:`torch.device`. .. note:: The index of the returned :class:`torch.device` will be ``None``, please use :func:`torch.accelerator.current_device_index` to know the current index being used. This API does NOT poison fork. For more details, see :ref:`multiprocessing-poison-fork-note`. Example:: >>> # xdoctest: >>> # If an accelerator is available, sent the model to it >>> model = torch.nn.Linear(2, 2) >>> if (current_device := current_accelerator(check_available=True)) is not None: >>> model.to(current_device) N)r_C_accelerator_getAcceleratorr)r%r s r"rr^sA4x33555B _  J 4r#c>tjS)zReturn the index of a currently selected device for the current :ref:`accelerator`. Returns: int: the index of a currently selected device. )rr'_accelerator_getDeviceIndexr#r"rr~s 8 / / 1 11r#z#Use `current_device_index` instead.)categorya (Deprecated) Return the index of a currently selected device for the current :ref:`accelerator`. Returns: int: the index of a currently selected device. .. warning:: :func:`torch.accelerator.current_device_idx` is deprecated in favor of :func:`torch.accelerator.current_device_index` and will be removed in a future PyTorch release. devicecft|d}tj|dS)a Set the current device index to a given device. Args: device (:class:`torch.device`, str, int): a given device that must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if this device index is negative. FoptionalN)rrr'_accelerator_setDeviceIndexr-rs r"rrs2%Ve<<` device type. .. warning:: :func:`torch.accelerator.set_device_idx` is deprecated in favor of :func:`torch.accelerator.set_device_index` and will be removed in a future PyTorch release. cbt|d}tj|S)aReturn the currently selected stream for a given device. Args: device (:class:`torch.device`, str, int, optional): a given device that must match the current :ref:`accelerator` device type. If not given, use :func:`torch.accelerator.current_device_index` by default. Returns: torch.Stream: the currently selected stream for a given device. Tr/)rrr'_accelerator_getStreamr2s r"rrs,%Vd;;;L 8 * *< 8 88r#streamcDtj|dS)aSet the current stream to a given stream. Args: stream (torch.Stream): a given stream that must match the current :ref:`accelerator` device type. .. note:: This function will set the current device index to the device index of the given stream. N)rr'_accelerator_setStream)r5s r"rrs  H##F+++++r#cft|d}tj|dS)aWait for all kernels in all streams on the given device to complete. Args: device (:class:`torch.device`, str, int, optional): device for which to synchronize. It must match the current :ref:`accelerator` device type. If not given, use :func:`torch.accelerator.current_device_index` by default. .. note:: This function is a no-op if the current :ref:`accelerator` is not initialized. Example:: >>> # xdoctest: +REQUIRES(env:TORCH_DOCTEST_CUDA) >>> assert torch.accelerator.is_available() "No available accelerators detected." >>> start_event = torch.Event(enable_timing=True) >>> end_event = torch.Event(enable_timing=True) >>> start_event.record() >>> tensor = torch.randn(100, device=torch.accelerator.current_accelerator()) >>> sum = torch.sum(tensor) >>> end_event.record() >>> torch.accelerator.synchronize() >>> elapsed_time_ms = start_event.elapsed_time(end_event) Tr/N)rrr'_accelerator_synchronizeDevicer2s r"rrs2.%Vd;;;L H++L99999r#cFeZdZdZdeeddfdZd dZdeddfdZ dS) raContext manager to set the current device index for the current :ref:`accelerator`. Temporarily changes the current device index to the specified value for the duration of the context, and automatically restores the previous device index when exiting the context. Args: device (Optional[int]): a given device index to temporarily set. If None, no device index switching occurs. Examples: >>> # xdoctest: +REQUIRES(env:TORCH_DOCTEST_CUDA) >>> # Set device 0 as the current device temporarily >>> with torch.accelerator.device_index(0): ... # Code here runs with device 0 as the current device ... pass >>> # Original device is now restored >>> # No-op when None is passed >>> with torch.accelerator.device_index(None): ... # No device switching occurs ... pass r-rNc"||_d|_dS)N)idxprev_idx)selfr-s r"__init__zdevice_index.__init__s r#cj|j+tj|j|_dSdSN)r=rr'_accelerator_exchangeDevicer>)r?s r" __enter__zdevice_index.__enter__ s/ 8 !H@@JJDMMM r#exc_infoc`|j&tj|jdSdSrB)r=rr' _accelerator_maybeExchangeDevicer>)r?rEs r"__exit__zdevice_index.__exit__s0 8  H 5 5dm D D D D D r#)rN) __name__ __module__ __qualname____doc__rintr@rDobjectrHr+r#r"rrs.x}DKKKKE&ETEEEEEEr#r)FrB)#rLtypingrtyping_extensionsrr_utilsrrmemoryrr r r r r rr__all__rMrboolrr-rr FutureWarningrrrStreamrrrrr+r#r"rWs(((((( 00000000                       .c&d:(5<:P@2c2222ZZ)   7Y 7d 7 7 7 7%   9 99 95< 9 9 9 9,u|,,,,,:: :::::6"E"E"E"E"E"E"E"E"E"Er#