&Vji+ddlZddlZddlmZddlmZddlmZmZm Z ddl Z ddl Z ddl m Z ddlmZgdZe ee jee jfZe e jefZee jjZee jjZeeZhdZe d d Ze d d eee jj fd e jjdefdZ!e d d e jjde"fdZ#e d GddZ$e d de jj%de jj%fdZ&dS)N)Mapping) dataclass)AnyOptionalUnion) compatibility)_get_qualified_name)get_acc_ops_nameget_node_targetis_node_output_tensorFxNetAccFusionsFinderlegalize_graph> call_method call_module call_functionF)is_backward_compatiblect|tr|S|jrd|jvr d|jS|jdd}|r|ndd|jS)Nacc_opsacc_ops.z torch._opsz torch.ops.) isinstancestr __module____name__replace)kmodules V/root/voice-cloning/.venv/lib/python3.11/site-packages/torch/fx/passes/tools_common.pyr r s|!S: :)q|33&!*&&&%% +  #*&&99QZ999 submodulesnodereturnc|jtvs0Jddtzd|jz|jdkrVt|jt sJ||j}t |dt|}t|S|jdkr0|j}|j d|j vr d |j nt|St|jt sJ|jS) a, Given a `node` returns its target typename. For "call_method" node, return node.target which is the name of that method being called. This could potential lead to conflict but should be okay because normally it's on a tensor. For "call_function" node, return typename of node.target. For "call_module" node, return typename of the module that node.target point to. If seeing "_VariableFunctionsClass" in the target name string, it will be replaced by "torch". e.g. _VariableFunctionsClass.relu would become torch.relu. zExpect op types of z, z , but found r_base_class_originrNrr) opCALLABLE_NODE_OPSjoinrtargetrgetattrtyper rrr )r!r"submod submod_typer)s rr r +s$ 7' ' ' ' *; < <O1O1O )v ( ( ($V,, $+s+++++{r ct|jdd}|duot|tjS)aChecks if the node output produces a Tensor or not. NOTE: This requires to run `ShapeProp` on the containing fx graph before calling this function. This is because it works by checking the `type` metadata on the node. This metadata is produced by the `ShapeProp`. r+N)metaget issubclasstorchTensor)r"type_s rr r Rs5 IMM&$ ' 'E   @E5eZdZUeed<eed<eed<eed<dZdS)!FxNetAccFusionsFinder.FusionGroup top_node_idxr;inputsnodes_need_processc|jvrdSj|j|j|jfd|jDdS)z5 Add a node to fusion group. NcBh|]}|jtv|jv|S)r&r'r;).0nr<s r z=FxNetAccFusionsFinder.FusionGroup.add_node..s=t000Qdj5H5H5H5H5Hr )r;rBaddrAdiscardupdateall_input_nodes)r<r"s` radd_nodez*FxNetAccFusionsFinder.FusionGroup.add_nodexstz!!  # ' ' - - - JNN4 K   % % % K  !1     r N)rr __qualname__int__annotations__NodeSetrMrEr r FusionGroupr?jsW$###     r rRN fusion_groupr?rAvisitedc.|D]}|||vr |||jtvr-|j||jkrQ||jvrdS|||j|r||dSdS)z Start from inputs and going reverse topological order. If any upstream node is in the fusion group, add all the nodes in this path to fusion group. NTF) rIr&r'r;indexr@recursive_add_noderLrM)r<rSrArTargs rrWz(FxNetAccFusionsFinder.recursive_add_nodes  C"'>> C   v...z$$|'@@@l(((tt&&|S5H'RR %%c***tt ur r#c\i}t|j}|D]}||vr|jtvrd|jvr!||jvr+||j||ht|j |h}|j rQ|j }| ||j td|jvra|jD]Y}|jtvr||jvr||| ||j tZ|j D]}|jtvrd|jvr||jvr%||t!|j|j||_| ||j t|j Qt|j|jks|xj|jzc_|jD] }|j||< |S)N tensor_meta)r@r;rArB)rT)r9r6r&r'r/rRr;rVsetrLrBpoprWrAusersrMminr@)r<resultr6r"rSuserrXrGs r__call__zFxNetAccFusionsFinder.__call__s/1(( > 3> 3Dv~~w/// ))4>))>B>N>N!Z--d33f4/00$(6 ?O??L 1( #6::<<''  'EE(! 11 $  7*;;;$<#555$$--d333//((/$'EE0 /Cv%666 $00 l000  ))#...03$14:3C3CC3H3H11L-++$$+ #,I1( T *++t~==,"44%+33A , 2F1II3 r r8)rrrN__doc__r2fx GraphModulerQr=rrRrNodeListrrWdictNoderarEr rr r ^s #ux3##### YF&* $$9$gx'($'" $$$$LD$ux}g56DDDDDDr r gmctjtjtjtjtjtjtjtjtj tj tj tj tjjjjtjjjjtjjjjtjjjjtjjjjg}t.|jjdtj}|jjD]}|jD]}|xxdz cc<t=j}|jjD]#}|dkr| |$itC|dkr|"}|#|fd|<|jD]]}|xxdzcc<|dkr?|j$dkr|j%|vr|&|H| |^tC|dktC|jtC|jjkrtOdfdD|jj(|_(||_|S)a Replace the graph of the given GraphModule with one that contains the same nodes as the original, but in topologically sorted order. This is used by the merge_matmul transformation below, which disturbs the topologically sorted order of its input GraphModule, so that this order is restored before further transformation. Arguments: gm: The graph module to topologically sort. It is modified in-place. Returns: The graph module in-place sorted rc|Sr8rE)xenvs rz legalize_graph../s c!fr rz&Input graph has cycles, unable to add c,g|]}|dk|S)rrE)rFr"indegs r z"legalize_graph..;s+5a5a5atPUVZP[_`P`P`dP`P`P`r ))operatorrImulsubfloordivtruedivmodleltgegteqner2opsatensym_constrain_rangedefaultsym_constrain_range_for_size _assert_asyncmsg scalar_tensor_assert_scalarrffromkeysr:r;rcGraphr] collectionsdequeappendlenpopleft node_copyr&r) appendleft RuntimeError_codegen) rhPRIORITIZED_OPS new_graphr"r`queuecurrmrps @@rrrsz*            *2 3; $( $, %-#O( MM"(.! , ,E  IJ  D $KKK1 KKKK *022E ;!   LL   .0C e**q..mmoo&&s,<,<,<,<==CI ' 'D $KKK1 KKKT{a7o--$+2P2P$$T****LL&&& e**q.. 9?c"(.1111 c5a5a5a5au5a5a5a c c   *IBH Ir )'rrrcollections.abcr dataclassesrtypingrrrr2torch.fxtorch.fx._compatibilityr torch.fx.noder __all__tupler3r9TensorsTensorOrTensorsrcrgrer[rQrNamesr'r nnModuler boolr r rdrrEr rrso######!!!!!!'''''''''' 111111------    el#T%,%77 8 g-.   ehm  S CCCe,,, : :-, :e,,,#UX_,-#5:X]####-,#Le,,,A A$AAA-,Ae,,,UUUUUUU-,Upe,,,Gux+G0DGGG-,GGGr