Vji&M 6ddlZddlZddlZddlmZddlmZmZmZm Z ddl Z ddl m Z m Z ddlmZmZmZddlmZmZmZGddZdd d e d eed eejjeeeeffd Zde eeejej fd e!e e e ffdZ"dS)N)Path)LiteralOptionalTupleUnion)deviceTensor)_coreFrame FrameBatch)_get_cuda_backendcreate_decoderERROR_REPORTING_INSTRUCTIONSceZdZdZddddddddeeeejej e e fde e d ed d e d e eeefd edde eee ejej ffdZde fdZde de fdZdede fdZdeejefde fdZdee fdZde defdZdeej ee fdefdZd&de de de defdZd e defd!Z!d eej ee fdefd"Z"d#e d$e defd%Z#dS)' VideoDecoderaA single-stream video decoder. Args: source (str, ``Pathlib.path``, bytes, ``torch.Tensor`` or file-like object): The source of the video: - If ``str``: a local path or a URL to a video file. - If ``Pathlib.path``: a path to a local video file. - If ``bytes`` object or ``torch.Tensor``: the raw encoded video data. - If file-like object: we read video data from the object on demand. The object must expose the methods `read(self, size: int) -> bytes` and `seek(self, offset: int, whence: int) -> int`. Read more in: :ref:`sphx_glr_generated_examples_decoding_file_like.py`. stream_index (int, optional): Specifies which stream in the video to decode frames from. Note that this index is absolute across all media types. If left unspecified, then the :term:`best stream` is used. dimension_order(str, optional): The dimension order of the decoded frames. This can be either "NCHW" (default) or "NHWC", where N is the batch size, C is the number of channels, H is the height, and W is the width of the frames. .. note:: Frames are natively decoded in NHWC format by the underlying FFmpeg implementation. Converting those into NCHW format is a cheap no-copy operation that allows these frames to be transformed using the `torchvision transforms `_. num_ffmpeg_threads (int, optional): The number of threads to use for decoding. Use 1 for single-threaded decoding which may be best if you are running multiple instances of ``VideoDecoder`` in parallel. Use a higher number for multi-threaded decoding which is best if you are running a single instance of ``VideoDecoder``. Passing 0 lets FFmpeg decide on the number of threads. Default: 1. device (str or torch.device, optional): The device to use for decoding. If ``None`` (default), uses the current default device. If you pass a CUDA device, we recommend trying the "beta" CUDA backend which is faster! See :func:`~torchcodec.decoders.set_cuda_backend`. seek_mode (str, optional): Determines if frame access will be "exact" or "approximate". Exact guarantees that requesting frame i will always return frame i, but doing so requires an initial :term:`scan` of the file. Approximate is faster as it avoids scanning the file, but less accurate as it uses the file's metadata to calculate where i probably is. Default: "exact". Read more about this parameter in: :ref:`sphx_glr_generated_examples_decoding_approximate_mode.py` custom_frame_mappings (str, bytes, or file-like object, optional): Mapping of frames to their metadata, typically generated via ffprobe. This enables accurate frame seeking without requiring a full video scan. Do not set seek_mode when custom_frame_mappings is provided. Expected JSON format: .. code-block:: json { "frames": [ { "pts": 0, "duration": 1001, "key_frame": 1 } ] } Alternative field names "pkt_pts" and "pkt_duration" are also supported. Read more about this parameter in: :ref:`sphx_glr_generated_examples_decoding_custom_frame_mappings.py` Attributes: metadata (VideoStreamMetadata): Metadata of the video stream. stream_index (int): The stream index that this decoder is retrieving frames from. If a stream index was provided at initialization, this is the same value. If it was left unspecified, this is the :term:`best stream`. NNCHWexact) stream_indexdimension_ordernum_ffmpeg_threadsr seek_modecustom_frame_mappingssourcerrrNHWCrrrr approximaterc  tjdd}||vr)td|dd|d||dkrtdd} |d }t |} t || |_t|j| \|_ |_ |_ |_ |_ d } || vr)td |dd| d|td|d|!ttj}n$t!|t"rt|}t%} t'j|j|j |||| | dS)Nz torchcodec.decoders.VideoDecoderrzInvalid seek mode (z). Supported values are z, .rzcustom_frame_mappings is incompatible with seek_mode='approximate'. Use seek_mode='custom_frame_mappings' or leave it unspecified to automatically use custom frame mappings.r)rr)decoderrrzInvalid dimension order (znum_ffmpeg_threads = z should be an int.)rr num_threadsrdevice_variantr)torch_C_log_api_usage_once ValueErrorjoin_read_custom_frame_mappingsr_decoder!_get_and_validate_stream_metadatametadatar_begin_stream_seconds_end_stream_seconds _num_framesstrget_default_device isinstance torch_devicer coreadd_video_stream) selfrrrrrrrallowed_seek_modescustom_frame_mappings_dataallowed_dimension_ordersr#s \/root/voice-cloning/.venv/lib/python3.11/site-packages/torchcodec/decoders/_video_decoder.py__init__zVideoDecoder.__init__cs $$%GHHH5 . . .IiII(, 2D(E(EIII  ! ,m1K1K|  &*" ,/I)D%** &'f JJJ  .M     M    &  $   $4 ": : :OOOO(, 2J(K(KOOO   %I 2IIIJJ J >13344FF  - - ![[F*,,  M*+*)"<      returnc|jSN)r/r6s r:__len__zVideoDecoder.__len__s r<keycnt|tsJtj|j|^}}|S)N frame_index)r2intr4get_frame_at_indexr*)r6rB frame_data_s r: _getitem_intzVideoDecoder._getitem_ints9#s#####0CPPP Qr<ct|tsJ|t|\}}}t j|j|||^}}|S)Nstartstopstep)r2sliceindiceslenr4get_frames_in_ranger*)r6rBrMrNrOrHrIs r:_getitem_slicezVideoDecoder._getitem_slicesg#u%%%%%KKD 22tT1 M     Q r<ct|tjr"|t |St|t r||Stdt|d)aReturn frame or frames as tensors, at the given index or range. .. note:: If you need to decode multiple frames, we recommend using the batch methods instead, since they are faster: :meth:`~torchcodec.decoders.VideoDecoder.get_frames_at`, :meth:`~torchcodec.decoders.VideoDecoder.get_frames_in_range`, :meth:`~torchcodec.decoders.VideoDecoder.get_frames_played_at`, and :meth:`~torchcodec.decoders.VideoDecoder.get_frames_played_in_range`. Args: key(int or slice): The index or range of frame(s) to retrieve. Returns: torch.Tensor: The frame or frames at the given index or range. zUnsupported key type: z$. Supported types are int and slice.) r2numbersIntegralrJrFrPrT TypeErrortype)r6rBs r: __getitem__zVideoDecoder.__getitem__s$ c7+ , , ,$$SXX.. . U # # ,&&s++ + TT#YY T T T   r<c4tj|jSr?)r4_get_key_frame_indicesr*r@s r:r\z#VideoDecoder._get_key_frame_indicess*4=999r<indexctj|j|\}}}t|||S)aReturn a single frame at the given index. .. note:: If you need to decode multiple frames, we recommend using the batch methods instead, since they are faster: :meth:`~torchcodec.decoders.VideoDecoder.get_frames_at`, :meth:`~torchcodec.decoders.VideoDecoder.get_frames_in_range`, :meth:`~torchcodec.decoders.VideoDecoder.get_frames_played_at`, :meth:`~torchcodec.decoders.VideoDecoder.get_frames_played_in_range`. Args: index (int): The index of the frame to retrieve. Returns: Frame: The frame at the given index. rDdata pts_secondsduration_seconds)r4rGr*r item)r6r]r`rarbs r: get_frame_atzVideoDecoder.get_frame_atsd$/3.E Mu/ / / +k+#((**-2244    r<rQcdtj|j|\}}}t|||S)zReturn frames at the given indices. Args: indices (torch.Tensor or list of int): The indices of the frames to retrieve. Returns: FrameBatch: The frames at the given indices. ) frame_indicesr_)r4get_frames_at_indicesr*r )r6rQr`rarbs r: get_frames_atzVideoDecoder.get_frames_atsL/3.H M/ / / +k+#-    r<rMrNrOct||||j\}}}tj|j|||}t |S)aReturn multiple frames at the given index range. Frames are in [start, stop). Args: start (int): Index of the first frame to retrieve. stop (int): End of indexing range (exclusive, as per Python conventions). step (int, optional): Step size between frames. Default: 1. Returns: FrameBatch: The frames within the specified range. rL)rPrQr/r4rSr*r )r6rMrNrOframess r:rSz VideoDecoder.get_frames_in_ranges_"%t44< I I I I V      % F     uW%5u%<= &    6:S :::: # %    6 U5<c+B%C     (###C#s#:####0 5 U    B U\4;67     *&#"&#27&# &#&#&#&#&#&#r<r)rr!rr=c.tj|}| |jx}tdtz|t |jkrtd|d|j|}t|tjj std|d|j tdtz|j }|j tdtz|j }|j tdtz|j }|||||fS) NzCThe best video stream is unknown and there is no specified stream. zThe stream index z is not a valid stream.zThe stream at index z is not a video stream. z-The minimum pts value in seconds is unknown. z-The maximum pts value in seconds is unknown. z!The number of frames is unknown. ) r4get_container_metadatabest_video_stream_indexr'rrRstreamsr2 _metadataVideoStreamMetadatabegin_stream_secondsend_stream_seconds num_frames)r!rcontainer_metadatar,rrrs r:r+r+sc 4W==.F FL OU./  s-56666R\RRRSSS!),7H h B C CXV VVVWWW$, ;* +   $8"* ;* +   "4" /2N N   $J   r<rcv t|drtj|ntj|}n+#tj$r}t d|d|d}~wwxYw|rd|vrt d|ddt fdd Dd t fd d Ddd v} rr|st d tj fd|dDtj }tjd|dDtj }tjfd|dDtj }t|t|cxkrt|ksnt d|||fS)a Parse custom frame mappings from JSON data and extract frame metadata. Args: custom_frame_mappings: JSON data containing frame metadata, provided as: - A JSON string (str, bytes) - A file-like object with a read() method Returns: A tuple of three tensors: - all_frames (Tensor): Presentation timestamps (PTS) for each frame - is_key_frame (Tensor): Boolean tensor indicating which frames are key frames - duration (Tensor): Duration of each frame readzInvalid custom frame mappings: z9. It should be a valid JSON string or a file-like object.NrjzWInvalid custom frame mappings. The input is empty or missing the required 'frames' key.rc3$K|] }|v|V dSr?r.0rB first_frames r: z._read_custom_frame_mappings..s-LLC 9K9KC9K9K9K9KLLr<)ptspkt_ptsc3$K|] }|v|V dSr?rrs r:rz._read_custom_frame_mappings..s-KK{8J8J8J8J8J8JKKr<)duration pkt_duration key_framezInvalid custom frame mappings. The 'pts'/'pkt_pts', 'duration'/'pkt_duration', and 'key_frame' keys are required in the frame metadata.c:g|]}t|SrrF)rframepts_keys r: z/_read_custom_frame_mappings..s%???U7^  ???r<)dtypec8g|]}t|dS)rr)rrs r:rz/_read_custom_frame_mappings..s%CCCUU;  CCCr<c:g|]}t|Srr)rr duration_keys r:rz/_read_custom_frame_mappings..s&DDDeU< ! !DDDr<z&Mismatched lengths in frame index data) hasattrjsonloadloadsJSONDecodeErrorr'nextr$tensorint64boolrR) r input_dataekey_frame_present all_frames is_key_framerrrrs @@@r:r)r)sB ,f55 3DI+ , , ,122    ja j j j     33 e   X&q)KLLLL#5LLLdSSGKKKK4KKKTL${2  , .?  V   ????*X*>???u{J<CCj.BCCC5:L|DDDDz(/CDDDEKH  OOs<00 A A A ACMM A A A AABBB |X --s8>A& A!!A&)#rrrVpathlibrtypingrrrrr$rr3r torchcodecr r4r r "torchcodec.decoders._decoder_utilsr rrrrFrrrr+r0rrrtupler)rr<r:rs 222222222222 000000007777777777l#l#l#l#l#l#l#l#d #'000 03-0 4> -sE5# EF 0000f7. eR\2;L!LM7. 666 !"7.7.7.7.7.7.r<