/;jinSddlmZddlZddlmZmZddlZddlZddl mZ ddl Z ddl m Z erddlmZ d?d@dZdAdZdBdZdAdZdBdZdCdDdZdEdZdFdGd"ZdHd&Z dIdJd*ZdKd.ZdFdLd0ZdMd4Z dIdNd6Z dOdPd=ZdQd>ZdS)R) annotationsN) TYPE_CHECKINGAny)helper)SequenceTupx np.ndarraysaturatebool round_modestrreturncRtj|tj}|tj}|dz dz}|tj}|dk}tj|tj}d||<|}|dkr|dzdktj} |dzdktj} |dzdktj} |dktj} | d k| d k| d kz| d kzz} tj|}d || |z<|r|d k| z|z}d||<||z }n`|d krA|d zdk}||z} |r|d k| z}d | |<|| tjz }n|dkrntd||tj}||||<|tj S)arConvert float32 NumPy array to float8e8m0 representation. If the input is not a float32 array, it will be cast to one first. Args: x: Input array to convert. saturate: Whether to saturate at max/min float8e8m0 value. round_mode: "nearest", "up", or "down". Returns: np.ndarray: Array of ml_dtypes.float8_e8m0fnu values. dtypenearesti@ri iriOFdownzUnsupported rounding mode: ) npasarrayfloat32viewuint32astypeuint16 zeros_likeuint8 ValueError ml_dtypesfloat8_e8m0fnu)r r r x_f32f_bitsexponent special_maskoutput normal_maskgrslsbround_up incrementmax_mask has_fractions K/root/voice-cloning/.venv/lib/python3.11/site-packages/onnx/numpy_helper.py to_float8e8m0r4s> Jq + + +E ZZ " "F" $H H t#L ]828 4 4 4FF< -KYx1 $ , ,RX 6 6x1 $ , ,RX 6 6x1 $ , ,RX 6 6!|##BH--FQ162cQh?@M(++ ,- ([()  $ D(H4{BH"#Ih I t  )Q. +-  ' D(H4H!&HX HOOBI... v   CzCCDDDrx((H";/F; ;;y/ 0 00datanpt.NDArray[np.uint8]dims Sequence[int]cztj|jdzg|j}|tjdz}|tjdz}|tjdz}||ddd<||ddd<|jtj|dzkr |dd }||d |S) aConvert a packed uint4 array to unpacked uint4 array represented as uint8. Args: data: A numpy array. dims: The dimensions are used to reshape the unpacked buffer. Returns: A numpy array of int8/uint8 reshaped to dims. rrNrFrefcheck)remptysizerr!prodresize)r6r8result array_low array_highs r3 _unpack_4bitrI_sXty1}oTZ 8 8 8Frx~~%I&J28A;;JF14a4LF14a4L {bgdmma''' MM$M''' Mr5arrayc@|tj}|j}|dzdk}|r||dzgd|dz}|dddxxdzcc<|ddd|dddzS) z[Convert a numpy array to flatten, packed int4/uint4. Elements must be in the correct range.r;rFr@r<Nr>rravelrrr!copyrCrE)rJ array_flatrC odd_sizeds r3 _pack_4bitx2rQxs##BH--2244J :DqA I64!8*u555$Jqt!t add jA. ..r5cXtj|jdzg|j}|dz|ddd<|dz dz|ddd<|dz dz|ddd<|dz dz|ddd<|jtj|kr|dtj|}||d |S) aConvert a packed uint2 array to unpacked uint2 array represented as uint8. Args: data: A numpy array. dims: The dimensions are used to reshape the unpacked buffer. Returns: A numpy array of int8/uint8 reshaped to dims. r>rrNr;rFr@)rrBrCrrDrE)r6r8rFs r3 _unpack_2bitrUsXty1}oTZ 8 8 8F$;F14a4LAI%F14a4LAI%F14a4LAI%F14a4L {RWT]]"""'$--( MM$M''' Mr5c|tj}|j}|dz}|r||d|z zgd|dz}|dddxxdzcc<|dddxxdzcc<|dddxxdzcc<|d dd|dddz|dddz|dddzS) z[Convert a numpy array to flatten, packed int2/uint2. Elements must be in the correct range.r>Fr@rSrNr;rTrrL)rJrOrCpad_lens r3 _pack_2bitx4rXs##BH--2244J :DQhGB41w;/05AAA$Jqt!tqt!tqt!t add jA. .ADqD1A AJqtRStDT TTr5tensoronnx.TensorProtobase_dirc |drtd|jtjjkrt d|j}tj|}tjtj |}tj |}|j }|jtjj krVt||}d|D}tj|||Stj|r tj|||drX|j} t,jdkr:tj| |} |tjjtjjtjjhvrCtj| tj} t?| | |S|tjj!tjj"hvrCtj| tj} tG| | |Stj| ||S|tjj$tjj%tjj&tjj'hvrtj(|j)tj* tj+tj,| |S|tjj-tjj.tjj/tjj0tjj1tjj2hvrtj(|j)tj* tj+tj ||S|tjjtjjtjjhvrtj(|j)tj* tj+tj} t?| | |S|tjj!tjj"hvrtj(|j)tj* tj+tj} tG| | |St||} |tjj3tjj4fvr=tj(| | ||Stj| |||S)a6Converts a tensor def object to a numpy array. This function uses ml_dtypes if the dtype is not a native numpy dtype. Args: tensor: a TensorProto object. base_dir: if external tensor exists, base_dir can help to find the path to it Returns: arr: the converted array. segmentz*Currently not supporting loading segments.z2The element type in the input tensor is UNDEFINED.c8g|]}|dS)utf-8)decode).0r-s r3 zto_array..s$ 6 6 6Aahhw 6 6 6r5raw_databigr)5HasFieldr" data_typeonnx TensorProto UNDEFINED TypeErrorrtensor_dtype_to_np_dtype$tensor_dtype_to_storage_tensor_dtypetensor_dtype_to_fieldr8STRINGgetattrrrrreshapeexternal_data_helperuses_external_dataload_external_data_for_tensorrdsys byteorder frombufferbyteswaptobytesINT4UINT4 FLOAT4E2M1r!rIrUINT2INT2rUBFLOAT16FLOAT16INT16UINT16rJ int32_dataint32rr FLOAT8E4M3FNFLOAT8E4M3FNUZ FLOAT8E5M2FLOAT8E5M2FNUZ FLOAT8E8M0BOOL COMPLEX64 COMPLEX128) rZr\ tensor_dtypenp_dtypestorage_np_dtype storage_fieldr8 utf8_stringsssrdr6s r3to_arrayrs)y!!GEFFF 4+555LMMM#L.|<>M ;D 4+222v}55 6 6 6 6 6z"~~$$X..66t<<<  33F;;R !??QQQ z""E? =E ! !}XX>>>GGIIQQSSH    !   "   '   =:::Dd++00:: :    "   !   =:::Dd++00:: :}XX666>>tDDD !      HV&bh 7 7 7 T")__ VBI   WT]] T(^^   % ' # ' #   HV&bh 7 7 7 T")__ VBH   T(^^ WT]]     # HV&bh 7 7 7 < re=<)rrvrur newbyteorderry)rJs r3tobytes_little_endianrsa {## 5;#8C#?#? U[55c::;; ==??r5name str | Nonec tj}|j|j|r||_|jtks$tj |jtj rtjj |_ | }|D]}t|tr.|j|dEt|t&r|j|ut)dtt+||St-j|j}|tjjtjjtjjhvrt7|}|tjjtjjhvrt=|}t?||_ ||_ |S)zConverts an array into a TensorProto including Args: array: a numpy array. name: (optional) the name of the tensor. Returns: TensorProto: the converted tensor def. r`zMUnrecognized object in the object array, expect a string, or array of bytes: )!rhrir8extendshaperrobjectr issubdtypestr_rorgflatten isinstancer string_dataappendencoderNotImplementedErrortypernp_dtype_to_tensor_dtyperzr{r|rQr}r~rXrrd)rJrrZ flat_arrayers r3 from_arrayr2s   F Ku{###   {f ek27 C C+2]]__   A!S!! "))!((7*;*;<<<<Au%% "))!,,,,)cQLL  +EK 8 8E    # U##    U##+E22FOF Mr5sequenceonnx.SequenceProto list[Any]c^|j}|tjjkrd|jDS|tjjkrd|jDS|tjjkrd|jDS|tjj krd|j DStd)zConverts a sequence def to a Python list. Args: sequence: a SequenceProto object. Returns: list: the converted list. c,g|]}t|Srrbvs r3rczto_list..xs<<< <<.zsCCC CCCr5c,g|]}t|Sr)to_listrs r3rczto_list..|s===q ===r5c,g|]}t|Sr)to_dictrs r3rczto_list..~s888q 888r5z8The element type in the input sequence is not supported.) elem_typerh SequenceProtoTENSOR tensor_values SPARSE_TENSORsparse_tensor_valuesSEQUENCEsequence_valuesMAP map_valuesrk)rrs r3rrms"ID&---<zfrom_list..s7!Q!QT*T4A<<"@"@!Q!Q!Q!Q!Q!Qr5zqThe element type in the input list is not the same for all elements and therefore is not supported as a sequence.zZThe element type in the input list is not a tensor, sequence, or map and is not supported.)rhrrlenrdictrlistrrrallrkrrrrrr from_listr from_dict) rrrrr first_elemrZseqmappings ` r3rrs!##H   . SAV j$ ' ' 2*.II  D ) ) 2*3II*1II&- "H C1 c!Q!Q!Q!QS!Q!Q!QQQ  M   D&--- L LF  " ) ):bj6H6H+I+I*J K K K K L d(1 1 1 > >C  $ + +Ys^^,< = = = = > d(, , , = =G   & & '(:(:'; < < < < = 5    Or5 map_proto onnx.MapProtodict[Any, Any]c^g}|jtjjkrt |j}nt |j}t|j}t|t|krtd|j dtt||dS)zConverts a map def to a Python dictionary. Args: map_proto: a MapProto object. Returns: The converted dictionary. z2Length of keys and values for MapProto (map name: z) are not the same.F)strict)key_typerhriror string_keyskeysrvaluesr IndexErrorrrzip)rkey_list value_lists r3rrsHT-444 -.. '')**J 8}}J'' @ N !   Hj777 8 88r5dict_c tj}|r||_t|}t j|dt j}tjj tjj tjj tjj tjj tjjtjjtjjh}t#fd|Dst%dt|}t j|d t# fd|Dst%dt)|}||_|tjjkr|j|n||vr|j||j||S)zConverts a Python dictionary into a map def. Args: dict_: Python dictionary name: (optional) the name of the map. Returns: MapProto: the converted map def. rc3HK|]}tj|kVdSNr result_type)rbkey raw_key_types r3rzfrom_dict..s2DDs##|3DDDDDDr5zfThe key type in the input dictionary is not the same for all keys and therefore is not valid as a map.c3HK|]}tj|kVdSrr)rbvalraw_value_types r3rzfrom_dict..s2GGr~c""n4GGGGGGr5zjThe value type in the input dictionary is not the same for all values and therefore is not valid as a map.)rhMapProtorrrrrrriINT8rINT32INT64UINT8rUINT32UINT64rrkrrrrorrrCopyFrom) rrrrrvalid_key_int_typesr value_seqrrs @@r3rrs I   ;;D>$q'**L.|<>BHUOO'"(););)?@@y  + >>EEeLLL uEEE F FFr5ctj|tjs0|tjtjtjtjfvr)tj|}tj |}ntj |}tj ||j |j |S)zSaturate cast for numeric types. This function ensures that values outside the representable range of the target dtype are clamped to the maximum or minimum representable value of that dtype. )rrintegerr#int4uint4int2uint2rroundfinfocliprrr)r rinfos r3 saturate_castr#ts }UBJ'' &5 5,, u%% HQKKu%% 71dh ) ) 0 0 7 77r5)Tr)r r r r r rrr )r6r7r8r9rr7)rJr rr7)rY)rZr[r\rrr )rJr rrr)rrrJr rr[)rrrr)NN)rrrrrrrr)rrrr)rrrrrr)rrrr)rrrrrrrr)r)rrrr r r rr )r r rr rr ) __future__rrutypingrrr#numpyr numpy.typingnptonnx.external_data_helperrhrcollections.abcrr4rIrQrUrXrrrrrrrrrrr#rr5r3r+sJ#""""" %%%%%%%% )(((((( H1H1H1H1H1V2 / / / /0 U U U UoSoSoSoSoSd(88888vPPPP,BF66666r9999222222jPPPP4CG00000h;<GGGGG>888888r5