Conv-TasNet waxtu-domen tàqale
Conv-TasNet reso neuronal la buy tàqale ay audio yu wuute (lu melni ñaari nit ñuy wax benn yoon) ci liggéey ci forme onde son bu ñor te du ci spectrogram.
Résumé
Dafa am solo ndax dafa taxawal bar bu bees ngir kalite tàqale kàddu yi ci noonu muy daw xél ngir jëfandikoo ci jamono dëgg.
Plongeur bu xóot
Sistemu tàqale yi fi yàgg a nekk dañuy soppi audio bi ci spectrogram, tàqale fréquence yi, ba noppi soppiwaat, loolu mooy ñàkka am xibaar ci fase yi, ba noppi di tënk kalite bi. Conv-TasNet (2019, Luo ak Mesgarani) dafa teggi loolu lépp. Dafay jëfandikoo encoder buñ jàng (convolution 1D) ngir soppi forme onde yu gàtt yi ci biir representation bu yomb, reso buy tàqale luy xayma benn mask ngir waxkat bu nekk, ak decoder buñ jàng buy tabaxaat forme onde bu sell bu nekk. Tàqalekat bi dafay boole ay convolution 1D yu ñuy woowe Reseau Convolutionnel Temporal (TCN), muy jàpp contexte bu sori te du dellu. Ñu tàggat ko ak SI-SNR budul soppiku ci balans bi ak tàggat permutation budul soppiku, mu raw masku spectrogram yi gën, muy résultat bu ñu yaakaaroon ni mooy yam ci kaw.
Gis-gis xarala
Li gëna am solo mooy ñu wecci soppi Fourier bu gàtt bi ak encodeur 1D-convolution buñ jàng, suko defee reso bi am répresentation audio bu baax ngir maskeer, du benn buñ defar ngir nit ñi diko seetaan. Separatëru TCN dafay jëfandikoo ay convolution yu yaatu yuñ dajale ak ay facteur dilatation yuy màgg exponentiel, loolu dafay joxe barab bu yaatu buy jot, boole ci des ci parallèle bu mat sëkk. Mask yi dañuy yokk màndarga yiñ kode ci wàllu elemen, ba noppi ab convolution buñ toxal dafay dekode bépp gis-gis buñ maskeer ci forme onde.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu tàqalu domen Conv-TasNet
Conv-TasNet moo jiite famiy xeetu domen waxtu. Ñi ko wuutu lu melni DPRNN, SepFormer, ak TF-GridNet ñoo gëna yokk kalite tàqale bi, waaye Conv-TasNet mingi wéy di nekk baseline bu dëgër, bu woyof te ba leegi ñu ngi koy jëfandikoo ci aparey bi ordinatër bi gëna tar. Xaarandil jëmmal TCN bu kompact bi di wéy di feeñ ci aparey yiy déglu, ay earbud, ak ay ndaje ci jamono dëgg, ñuy faral di distiye wala ñu kantise ngir dox ci ay milisegond ci puce mobile yi.
Doxal ci àdduna dëgg
Tàqale ñaari waxkat yuy jaxasoo ci ndaje buñ enregistre suko defee ku nekk ci ñoom mëna bind bu baax.
Yokkateg kàddu ci earbuds ak aparey yiy xàjjale ki ñuy wax ak waxtaan wi ci ginaaw.
Njëkkal defar audio call-center bu bari bruit balaa nga koy jox ci xàmmee kàddu yi ci saa si.
Raxas waxtaan yiy jaxasoo ci biir podcast wala filmu ginaaw defar.
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Conv-TasNet Time-Domain Separation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Tàqale Musik Open-Unmix
Laaj yi ñuy faral di laaj
Luy Conv-TasNet diggante waxtu ak domen?
Conv-TasNet reso neuronal la buy tàqale ay audio yu wuute (lu melni ñaari nit ñuy wax benn yoon) ci liggéey ci forme onde son bu ñor te du ci spectrogram. Dafa am solo ndax dafa taxawal bar bu bees ngir kalite tàqale kàddu yi ci noonu muy daw xél ngir jëfandikoo ci jamono dëgg.
Lan mooy màndarga Conv-TasNet buñu ko méngale ak sistemu tàqale yu njëkk ya?
Conv-TasNet dafay wecci pipeline STFT bu takku bi ak encodeur/decodeur buñ jàng suko defee mu tàqale audio bi ci domaine waxtu ci forme onde bu ñor.
Ban xeetu reso la Conv-TasNet di jëfandikoo ngir tàqale ay mbir?
Separatër bi TCN la buñ tabax ci ay convolution 1D yu yaatu yuñ dajale, di joxe barab bu yaatu buy jot te ba noppi des ci parallèle.
Lan mooy wecci coppite Fourier bu gàtt bu yàgg bi ci Conv-TasNet?
Lu moy STFT bu takku, ab convolution 1D buñu jàng mooy encoder ay piyeesu forme onde ci benn représentation buñ jagleel ngir maskeer.
Ban fonction perte mooy gëna am solo ci tàggat Conv-TasNet?
Conv-TasNet dañu ko tàggat ak SI-SNR perte boole ci tàggat permutation-invariant ngir mëna jëflante ak njubluwaay buñu xamul ci kàddukat yu tàqaloo yi.
Ban njariñ la Conv-TasNet am ci tàqale kàddu yi?
Ni Conv-TasNet moytu ñàkka am fase ci anam spectrogram yi, dafa weesu masku fréquence bi war.