%Vji;"UddlZddlZddlmZddlmZddlZddlmZm Z GddZ de de d efd Z d Z e aeed <ejd ZGddZddZdS)N)Callable) deprecated)KernelRegistrationHandlecneZdZdZdefdZedZejdZddde d ed e fd Z d S) FakeImplHolderz0A holder where one can register an fake impl to.qualnamec"||_g|_dSN)r kernels)selfr s R/root/voice-cloning/.venv/lib/python3.11/site-packages/torch/_library/fake_impl.py__init__zFakeImplHolder.__init__s% &( cPt|jdkrdS|jdS)Nr)lenr )r s rkernelzFakeImplHolder.kernels) t|   ! !4|Brc td)NzUnable to directly set kernel. RuntimeError)r values rrzFakeImplHolder.kernels;<<|sj%tdjdjjdtjjdrtdjdtjjdrtdjdt||j fd }tj}| j|d| t|}|S) z}Register an fake impl. Returns a RegistrationHandle that one can use to de-register this fake impl. Nz!register_fake(...): the operator z( already has an fake impl registered at .Metaz already has an DispatchKey::Meta implementation via a pre-existing torch.library or TORCH_LIBRARY registration. Please either remove that registration or don't call register_fake.CompositeImplicitAutograda% already has an implementation for this device type via a pre-existing registration to DispatchKey::CompositeImplicitAutograd.CompositeImplicitAutograd operators do not need an fake impl; instead, the operator will decompose into its constituents and those can have fake impls defined on them.c<jdSr )r remove)rr srderegister_fake_kernelz7FakeImplHolder.register..deregister_fake_kernelNs L   ' ' ' ' 'rr) rrr rtorch_C%_dispatch_has_kernel_for_dispatch_keyrr appendconstruct_meta_kernelimplr) r rrlibrr$ meta_kernelhandlers ` @rregisterzFakeImplHolder.register"sq {&"- --{)--- x==dmVTT "& &&&x== : #< <<<   f%% F### ( ( ( ( ( (,DM4@@   VNSSS#$:;; rN) __name__ __module__ __qualname____doc__strrpropertyrsetterrrr.rrrr s::(((((  X  ]==]=CH3333&)3 333333rrr fake_impl_holderrcpjJtjjjfd}|S)NcjJjjfd}t|5j|i|cdddS#1swxYwYdS)Nc.tdd)Nz (a): You're trying to run this operator with meta Tensors (as opposed to FakeTensors), but this operator may return an output Tensor with data-dependent shape. Meta Tensors don't support operators with outputs that have data-dependent shapes but FakeTensors do. If your operator does not return an output with data-dependent shape, make sure the FakeTensor and/or meta kernel does not call torch.library.get_ctx(). Otherwise, please use FakeTensors.r)r rsr error_on_ctxz@construct_meta_kernel..meta_kernel..error_on_ctx`s8OOvOOO   r)rrset_ctx_getter)argskwargsr;rr7r s @rr,z*construct_meta_kernel..meta_kernel[s&222!(/      L ) ) < <*#*D;F;; < < < < < < < < < < < < < < < < < >> # An operator with data-dependent output shape >>> lib = torch.library.Library("mymodule", "FRAGMENT") >>> lib.define("mymodule::custom_nonzero(Tensor x) -> Tensor") >>> >>> @torch.library.register_fake("mymodule::custom_nonzero") >>> def _(x): >>> # Number of nonzero-elements is data-dependent. >>> # Since we cannot peek at the data in an fake impl, >>> # we use the ctx object to construct a new symint that >>> # represents the data-dependent size. >>> ctx = torch.library.get_ctx() >>> nnz = ctx.new_dynamic_size() >>> shape = [nnz, x.dim()] >>> result = x.new_empty(shape, dtype=torch.int64) >>> return result >>> >>> @torch.library.impl(lib, "custom_nonzero", "CPU") >>> def _(x): >>> x_np = x.numpy() >>> res = np.stack(np.nonzero(x_np), axis=1) >>> return torch.tensor(res, device=x.device) Nzctx.new_dynamic_size(min=z, max=zZ): expected min and max to be statically known ints but got SymInt. This is not supported.rzc, ...): expected min to be greater than or equal to 0: this API can only create non-negative sizes.) rLallow_dynamic_output_shape_opsr% _subclasses fake_tensorDynamicOutputShapeExceptionrM isinstanceSymInt ValueError allocate_sizerVs rrUzFakeImplCtx.new_dynamic_sizesf O #?A $#/KKDHUU U c5< ( ( JsEL,I,I *C**s***  77'C'''  T_c3777r) r/r0r1r2rr FutureWarningr%r^rWrUr6rrrHrHs ZW-.4777EL777 7'(TF8F8F8elF8F8F8F8F8F8rrHc|}tjjj||||SrT)rWr%fx experimentalsymbolic_shapes_constrain_range_for_size)rKmin_valmax_valresults rr`r`sG  - - / /F H)CCGD Mr)rN) contextlibr?typingrtyping_extensionsrr%torch._library.utilsrrrr3r)rBrC__annotations__contextmanagerr<rHr`r6rrrpsO(((((( ;;;;;;;;JJJJJJJJZC>h4'8&&& !!!W8W8W8W8W8W8W8W8tr