Nkewa oge-ngalaba Conv-TasNet
Conv-TasNet bụ netwọk akwara nke na-ekewa ọdịyo agwakọtara (dị ka mmadụ abụọ na-ekwu okwu n'otu oge) site n'ịrụ ọrụ ozugbo na ụdị ụda ụda dị nro kama ịbụ spectrogram.
Nchịkọta
It matters because it set a new bar for speech separation quality while running fast enough for real-time use.
Ime miri emi
Sistemụ nkewa ọdịnala na-atụgharị ụda ka ọ bụrụ spectrogram, kewapụta frequencies, wee tụgharịa azụ, nke na-efunahụ ozi nke oge ma gbochie ogo. Conv-TasNet (2019, Luo na Mesgarani) na-amali nke ahụ kpamkpam. Ọ na-eji ihe nkpuchi amụtara (a convolution 1D) iji tụgharịa mkpirisi ebili mmiri dị mkpụmkpụ ka ọ bụrụ ihe nnọchi anya dị n'ime na-agbanwe agbanwe, netwọk nkewa nke na-eme atụmatụ ihe nkpuchi maka ọkà okwu ọ bụla, yana ihe nrụzi amụtara nke na-ewughachi ụdị ebili mmiri ọ bụla dị ọcha. Onye nkewa ahụ bụ nchịkọta nke convolutions 1D gbasasịrị akpọsa Temporal Convolutional Network (TCN), nke na-ewepụta ọnọdụ dị ogologo na-enweghị nlọghachi. N'ịbụ onye a zụrụ ya na mfu SI-SNR na-adịghị agbanwe agbanwe na ọzụzụ na-adịghị agbanwe agbanwe, ọ karịrị ihe mkpuchi spectrogram kacha mma, nsonaazụ nke a chere na ọ bụ oke elu.
Nghọta nka nka
Isi aghụghọ bụ iji ngbanwe 1D-convolution amụta dochie mgbanwe obere oge dị mkpirikpi, yabụ netwọk ahụ na-ahụ ihe nnọchi anya ọdịyo emebere maka nkpuchi kama ịbụ nke emere maka nlele mmadụ. Onye na-ekewa TCN na-eji convolutions gbasasịrị agbagọ nwere ihe na-eto eto nke ukwuu, na-enye nnukwu ogige nnabata ka ọ na-anọkọ nke ọma. Masks na-amụba njirimara ndị etinyere n'usoro amamihe, yana ntụgharị ntụgharị na-ekpebi ihe nnọchite anya nke ọ bụla kpuchie n'ụdị ifegharị.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke nkewa oge-ngalaba Conv-TasNet
Conv-TasNet zụlitere ezinụlọ dum nke ụdị ngalaba oge. Ndị ga-aga nke ọma dị ka DPRNN, SepFormer, na TF-GridNet kwalitere ịdịmma nkewa dị elu, mana Conv-TasNet ka bụ ntọala siri ike, dị fechaa ma ka na-ebuga ya na ngwaọrụ ebe mgbako siri ike. Na-atụ anya nhazi TCN kọmpat ya ka ọ na-apụta na ihe enyemaka ịnụ ntị, ntị ntị, na nzụkọ ozugbo, na-atụgharịkarị ma ọ bụ tụọ ka ọ na-agba n'ime milliseconds na ibe mkpanaka.
Mmejuputa n'ezie n'ụwa
Na-ekewa ndị ọkà okwu abụọ na-ejikọta ọnụ na nzukọ e dekọrọ ka e wee nwee ike idegharị nke ọ bụla nke ọma.
Nkwalite okwu na igwe ntị na ihe enyemaka ịnụ ihe na-ekewapụ onye na-ekwu okwu na mkparịta ụka ndabere.
Na-ebu ụzọ hazie ọdịyo etiti oku na-eme mkpọtụ tupu inye ya nri ka ọ bụrụ njirimara okwu akpaka.
Na-ehicha mkparịta ụka na-agafe agafe na pọdkastị ma ọ bụ ihe nkiri mgbe emepụtara ya.
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Conv-TasNet Time-Domain Separation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Mepee-Unmix Music Nkewa
Ajụjụ a na-ajụkarị
What is Conv-TasNet Time-Domain Separation?
Conv-TasNet bụ netwọk akwara nke na-ekewa ọdịyo agwakọtara (dị ka mmadụ abụọ na-ekwu okwu n'otu oge) site n'ịrụ ọrụ ozugbo na ụdị ụda ụda dị nro kama ịbụ spectrogram. Ọ dị mkpa n'ihi na ọ na-edozi mmanya ọhụrụ maka ịdịmma nkewa okwu ka ọ na-agba ọsọ ọsọ maka iji oge eme ihe.
Kedu ihe bụ nkọwapụta nke Conv-TasNet ma e jiri ya tụnyere sistemụ nkewa mbụ?
Conv-TasNet na-eji koodu nzuzo/decoder amụtara dochie pipeline STFT etinyere n'otu oge ka ọ na-ekewa ọdịyo na mpaghara oge na ụdị waveform.
Kedu ụdị netwọkụ Conv-TasNet na-eji dị ka modul nkewa ya?
Onye na-ekewapụta bụ TCN wuru site na convolutions 1D gbasasịrị agbasa, na-enye nnukwu ogige nnabata ka ọ na-adakarị.
Kedu ihe na-anọchi mgbanwe mgbanwe oge dị mkpirikpi nke anọ na Conv-TasNet?
Kama STFT edobere anya, convolution 1D mụtara na-edobe mkpọka ebili mmiri ka ọ bụrụ ihe nnochite anya kachasị maka nkpuchi.
Kedu ọrụ mfu bụ isi na ọzụzụ Conv-TasNet?
A zụrụ Conv-TasNet site na mfu SI-SNR yana ọzụzụ na-adịghị agbanwe agbanwe iji jikwaa ịtụ ndị na-ekwu okwu kewapụrụ iche.
Kedu ihe pụtara ìhè Conv-TasNet rụpụtara na nkewa okwu?
Site n'izere mfu nke usoro spectrogram, Conv-TasNet gafere akara nkpuchi nkpuchi oge kacha mma.