QVji UddlmZddlmZddlZddlmZddlmZdee fdZ dee fdZ eeeeZ ee d <eeZee d <ejgZe dd e d edeeejejfee efffdZdejdefdZdeedejdefdZdS))Optional) TypeAliasN)Tensor)no_gradreturncFdddtjgS)z:Return the device type list that supports foreach kernels.cudaxpumtiatorch_C_get_privateuse1_backend_nameT/root/voice-cloning/.venv/lib/python3.11/site-packages/torch/utils/_foreach_utils.py&_get_foreach_kernels_supported_devicesr s E658#I#I#K#K LLrcLddddddtjgS)zEReturn the device type list that supports fused kernels in optimizer.mpsr r hpucpur r rrr$_get_fused_kernels_supported_devicesrs1     ..00 rTensorListListIndicesFtensorlistlist with_indicescBtj||SN)r r"_group_tensors_by_device_and_dtype)rrs rrr+s 8 6 6~| T TTrdevicecr|jtdgzvotj S)Nr)typerr jit is_scripting)r s r_device_has_foreach_supportr%3s8 >@@E7JK ) &&(( (rtensorscRt|otd|DS)Nc3JK|]}|dupt|tvVdSr)r"_foreach_supported_types).0ts r z'_has_foreach_support..;sH77=>T 8T!WW 88777777r)r%all)r&r s r_has_foreach_supportr.:s? &v . . 377BI77744r)F)typingrtyping_extensionsrr rtorch.autograd.grad_moderliststrrrr__annotations__intrr)booldicttupler dtyperr%r.rrrr:s'''''' ,,,,,,MS MMMM d3i    !hv&6!78 888#Y!L> UU"UU % ek) *E.'2I,J JKUUU U $v, r