0;jinPdZddlmZddlZddlmZGddejZdS)zConvolutionModule definition.)TupleN)nnc eZdZdZdejdddfdededejd ed e d e f fd Z e j d e j e j d fde jde jde jdee je jffdZxZS)ConvolutionModulez%ConvolutionModule in Conformer model. batch_normFTchannels kernel_size activationnormcausalbiasc  ttj|d|zddd||_|r d}|dz |_n|dz dzdksJ|dz dz}d|_tj|||d||||_|dvsJ|dkr!d|_tj||_ n d |_tj ||_ tj||ddd||_ ||_ d S) zConstruct an ConvolutionModule object. Args: channels (int): The number of channels of conv layers. kernel_size (int): Kernel size of conv layers. causal (int): Whether use causal convolution or not r)r stridepaddingr)rrgroupsr)r layer_normrFTN) super__init__rConv1dpointwise_conv1lorderdepthwise_convuse_layer_norm BatchNorm1dr LayerNormpointwise_conv2r ) selfr r r r r rr __class__s i/root/voice-cloning/.venv/lib/python3.11/site-packages/chatterbox/models/s3gen/transformer/convolution.pyrzConvolutionModule.__init__sP !y  L      G%/DKK !Oq(A----"Q1,GDK i      33333 <  "'D x00DII"&D  X..DI!y      %rrr)dtypexmask_padcachereturnc|dd}|ddkr||d|jdkr|ddkr*tj||jdfdd}nt|d|dksJ|d|dksJtj||fd}|d|jksJ|dddd|j df}n!tj d|j |j }| |}tj |d}||}|jr|dd}|||}|jr|dd}||}|ddkr||d|dd|fS) aCompute convolution module. Args: x (torch.Tensor): Input tensor (#batch, time, channels). mask_pad (torch.Tensor): used for batch padding (#batch, 1, time), (0, 0, 0) means fake mask. cache (torch.Tensor): left context cache, it is only used in causal convolution (#batch, channels, cache_t), (0, 0, 0) meas fake cache. Returns: torch.Tensor: Output tensor (#batch, time, channels). rrrgconstant)dimNr$)r%device) transposesize masked_fill_rr functionalpadtorchcatzerosr%r-rglurrr r r)r r&r'r( new_caches r"forwardzConvolutionModule.forwardZs<$ KK1   ==  a   NNH9c * * * ;??zz!}}!!M%%a$+q)9:sKKzz!}}q 1111zz!}}q 1111Iuaja000FF1II ++++!!!QQQ -.II  IQWQXNNNI   # # M  aQ  ' '    " "   " Aq!!A OODIIaLL ) )   " Aq!!A   # # ==  a   NNH9c * * *{{1a  )++r#)__name__ __module__ __qualname____doc__rReLUintModulestrboolrr3onesr5Tensorrr8 __classcell__)r!s@r"rrs//%')0) %" =%=%=%!=% Y=% =%  =%  =%=%=%=%=%=%D",IUZ!H!H!H)ek)44 7,7, <7,,7,| 7, u|U\) * 7,7,7,7,7,7,7,7,r#r)r<typingrr3rr?rr#r"rGsz $# y,y,y,y,y, y,y,y,y,y,r#