UMHLAHLANDLELA WE-AI womsindo

Ukuthuthukisa Inkulumo Yomsindo2

I-Noise2Noise iqhinga lokuqeqesha elivumela imodeli ukuthi ifunde ukususa umsindo ngaphandle kokubona ireferensi ehlanzekile, ngokufunda kumapheya wezinguqulo ezihlukene-zomsindo wesignali efanayo.

2 amaminithi ukufundaIgcine ukubuyekezwa

Uhlolojikelele

For speech enhancement it matters because clean recordings are expensive or impossible to obtain, yet noisy ones are everywhere.

I-Deep Dive

Yethulwe abacwaningi be-NVIDIA ngo-2018, i-Noise2Noise yenza isimangalo esimangazayo: ungaqeqesha i-denoiser usebenzisa izibonelo ezonakele kuphela. Ukuqonda kuyizibalo. Uma unikeza inethiwekhi izinguqulo ezimbili ezinomsindo zesiginali efanayo eyisisekelo bese uyicela ukuthi ibhale enye kwenye isebenzisa ukulahlekelwa njengephutha elilinganiselwe eliyisikwele, inethiwekhi ayikwazi ukubikezela umsindo ongahleliwe kumpokophelo, ngakho okungcono kakhulu engakwenza ukukhipha inani elilindelekile, okuyisignali ehlanzekile. Umsindo uyaphela. Kusetshenziswa enkulumweni, uthatha iphimbo elihlanzekile, wengeze amasampuli amabili omsindo azimele, bese uqeqesha imodeli ukubikezela isiqeshana esisodwa esinomsindo kwesinye. Ngokucatshangelwa imodeli isusa umsindo ekurekhodweni kwangempela. Lokhu kubekela eceleni ibhodlela eliyinhloko lokuphikiswa kwemisindo okugadiwe: okudinga umsindo weqiniso eliphansi elihlanzeke ngokuphelele.

I-Technical Insight

Izibalo zincike endaweni lapho ukulahlekelwa kwe-L2 (okusho iphutha eliyisikwele) kuncishiswa ngokwencazelo enemibandela. Uma umsindo owengezwe kumpokophelo unguziro futhi uzimele emsindweni wokufakwayo, umsindo ongaqageleki unikela kuphela umehluko oqhubekayo ekulahlekeni, ngakho ukwehla kwe-gradient kushayela inethiwekhi kusignali engaphansi ehlanzekile. Umbono ofanayo usebenza nezinye izilinganiso: ukulahlekelwa kwe-L1 kubuyisela i-median, kuwusizo kumsindo osheshayo.

I-Strategic Impact

Finyelela futhi ufinyelele

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Izindleko kanye nesabelomali

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Isivinini nesikali

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Ikusasa Lokuthuthukiswa Kwenkulumo Ye-Noise2Noise

I-Noise2Noise ivule umndeni wezindlela zokuzilawula ozigadile, ezifaka i-Noise2Void ne-Noise2Self, ezikhulula izimfuneko ezimayelana nokufunda kumasampula awodwa anomsindo. Enkulumweni, lindela ukuthi le mibono inikeze amandla ekuthuthukisweni okukudivayisi kwezinsizakuzwa, izingcingo, nokurekhodwa kwendawo lapho ukuqoqa izinkomba ezihlanzekile kungenangqondo. Ehlanganiswe namavokhoda akhiqizayo, amasistimu esikhathi esizayo angase angagcini nje ngokususa umsindo kodwa akhe kabusha ngokusobala okuqukethwe kwenkulumo okusikiwe noma okonakele kuyilapho ehlala ethembekile kusipika.

Ukuqaliswa Komhlaba Wangempela

Ukuhlanza inkambu noma okurekhodiwe kwengobo yomlando lapho kungekho khona inkomba ehlanzekile yenkulumo yokuqala

Ukuthuthukisa ukucaciseleka kwekholi yezwi kumafoni namalaptop ngokuqeqesha ama-denoisers ekuthwebuleni okunomsindo komhlaba wangempela

Ukuthuthukisa inkulumo yezinsiza-kuzwa kusetshenziswa ukurekhodwa okunomsindo okubhanqiwe esikhundleni somsindo ohlanzekile ongatholakali

Ukubuyisela i-podcast yakudala enomsindo noma amakhasethi ezingxoxo lapho kusinda kuphela izinguqulo ezonakele

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Qhubeka Uhlole

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Noise2Noise Speech Enhancement quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Qala imibuzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Umhlahlandlela olandelayo

I-Kaldi Speech Recognit Toolkit

Imibuzo evame ukubuzwa

What is Noise2Noise Speech Enhancement?

I-Noise2Noise iqhinga lokuqeqesha elivumela imodeli ukuthi ifunde ukususa umsindo ngaphandle kokubona ireferensi ehlanzekile, ngokufunda kumapheya wezinguqulo ezihlukene-zomsindo wesignali efanayo. Ukuze kuthuthukiswe inkulumo kubalulekile ngoba okuqoshiwe okuhlanzekile kuyabiza noma akulula ukukuthola, kodwa okunomsindo kukho yonke indawo.

Iyini isimangalo esiyinhloko esimangalisayo se-Noise2Noise?

I-Noise2Noise ibonise ukuthi ungakwazi ukuqeqesha i-denoiser esebenzayo usebenzisa amapheya kuphela ezibonelo ezonakele, ngaphandle kwethagethi ehlanzekile.

Kungani inethiwekhi ingakwazi ukumane ibambe ngekhanda umsindo kusiqeshana esiqondiwe?

Ngenxa yokuthi umsindo walokho okuqondiwe awuhleliwe futhi awuzimele kokokufaka, inethiwekhi ayikwazi ukukubikezela futhi esikhundleni salokho iguqulela kunani elihlanzekile elilindelwe.

Ngaphansi kokulahlekelwa kwe-L2 (iphutha eliyisikwele), inethiwekhi ihlangana ibheke kuphi?

Ukulahlekelwa kwe-L2 kuncishiswa ngencazelo enemibandela, ngakho-ke ngomsindo wethagethi ozimele oyiziro-incazelo inethiwekhi ikhipha isignali ehlanzekile engaphansi.

Yini okufanele ibe yiqiniso ngomsindo owengezwe kulokho okuhlosiwe ukuze iqhinga lisebenze?

Umsindo oqondiwe udinga ukuthi ube nguziro futhi uzimele ngokwezibalo kumsindo wokufakwayo ukuze ube nesilinganiso phakathi nokuqeqeshwa.

Ukushintsha ukusuka ekulahlekelweni kwe-L2 ukuya ekulahlekelweni kwe-L1 kwenza inethiwekhi ilulame yisiphi isibalo?

Ukulahlekelwa kwe-L1 (iphutha eliphelele) kuncishiswa ku-median, enamandla kakhulu emsindweni osheshayo.