UMHLAHLANDLELA WE-AI womsindo

Ukuhlukaniswa Kwenkulumo kanye Nenkinga Ye-Cocktail Party

Ukuhlukaniswa kwenkulumo kuwumsebenzi wokudonsa amazwi ngamanye ngaphandle kokurekhodiwe lapho abantu abambalwa bekhuluma ngesikhathi esisodwa.

Uhlolojikelele

Ukuhlukaniswa kwenkulumo kuwumsebenzi wokudonsa amazwi ngamanye ngaphandle kokurekhodiwe lapho abantu abambalwa bekhuluma ngesikhathi esisodwa. Ibhekana 'nenkinga yephathi ye-cocktail' abantu abayixazulula kalula kodwa imishini ikuthola kunzima ngempela.

Ukuhlukaniswa Kwenkulumo kanye Nenkinga Yephathi Ye-Cocktail kuhlezi ekuhambeni komsebenzi kwe-audio-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.

I-Deep Dive

Ephathini enomsindo, ungagxila engxoxweni eyodwa kuyilapho ukuhlunga okunye, ikhono isazi sokusebenza kwengqondo u-Colin Cherry saqamba ngokuthi 'inkinga yephathi ye-cocktail' ngo-1953. Amakhompiyutha athwala kanzima ngenxa yokuthi amazwi agqagqene ahlangana abe i-waveform eyodwa, futhi uhlelo alazi kusengaphambili ukuthi zingaki izikhulumi ezikhona noma ukuthi imuphi umsindo okabani. Ama-algorithms okuhlukanisa inkulumo athatha lowo msindo oxubile futhi akhiphe ithrekhi ehlukile, ehlanzekile yesipika ngasinye. Izindlela zakuqala zazisebenzisa izindlela zezibalo kanye nezinhlu zamakrofoni ukuze zisebenzise izinkomba zendawo. Ukuphumelela kufike namamodeli okufunda ajulile afana ne-Deep Clustering kanye ne-TasNet/Conv-TasNet, afunda ukufihla noma ukwakha kabusha izwi ngalinye ngokuqondile ku-waveform, ngisho nombhobho owodwa.

I-Technical Insight

Amasistimu amaningi asebenza esizindeni esifundiwe noma se-spectrogram: inethiwekhi ye-neural ilinganisela 'imaski' yesipikha ngasinye okuthi, uma sisetshenziswa kungxube, ihlukanise lelo zwi. Amamodeli esizinda sesikhathi afana ne-Conv-TasNet eqa i-spectrogram ngokuphelele futhi asebenze kumasampuli aluhlaza ukuze uthole ukwethembeka okuphezulu nokubambezeleka okuphansi. Inselele eyinhloko inkinga yokuvumela, enquma ukuthi imaphi amamephu wesiteshi okukhiphayo ukuthi isiphi isipikha, esixazululwa ngokuqeqeshwa okungaguquguquki kwemvume ukuze imodeli ingajeziswa ngoku-oda okukhiphayo.

I-Mastering Speech Separation kanye ne-Cocktail Party Problem

Ukuhlukaniswa kwenkulumo kuwumsebenzi wokudonsa amazwi ngamanye ngaphandle kokurekhodiwe lapho abantu abambalwa bekhuluma ngesikhathi esisodwa. Ibhekana 'nenkinga yephathi ye-cocktail' abantu abayixazulula kalula kodwa imishini ikuthola kunzima ngempela. Ukuhlukaniswa Kwenkulumo kanye Nenkinga Yephathi Ye-Cocktail kuhlezi ekuhambeni komsebenzi kwe-audio-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha Ukuhlukaniswa Kwenkulumo kanye Nenkinga Yeqembu Le-Cocktail njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa Ukuhlukaniswa Kwenkulumo kanye ne-Cocktail Party Problem aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthunyelwa. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Lokuhlukaniswa Kwenkulumo kanye Nenkinga Yephathi Ye-Cocktail

Ukwehlukana kuya ezimeni ezivulekile, zomhlaba wangempela: izinombolo ezingaziwa nezishintshayo zezikhulumi, amagumbi anomsindo, nomsindo osakazwayo oqhubekayo. Isizinda sesipikha esiqondiwe, lapho unikeza khona imodeli isampula yezwi elifushane ukuze ikhiphe lowo muntu, ikhuphuka ngokushesha. Amamodeli ahlanganisiwe omsindo nokubukwayo asebenzisa ukunyakaza kwezindebe ukuze ahlukanise amazwi. Lindela lawa makhono ashumekwe kuzinsiza-kuzwa, ama-earbud, nokulotshwa komhlangano, okuvumela amadivayisi agqamise noma ubani ofuna ukuzwa.

Ukuqaliswa Komhlaba Wangempela

Amathuluzi okuloba omhlangano ahlukanisa izipikha ezeqayo ukuze amagama omuntu ngamunye abalulwe ngendlela efanele kumanothi.

Izinsiza-kuzwa ezithuthukisiwe zihlukanisa isikhulumi esisodwa endaweni yokudlela egcwele abantu ukuze yenze ingxoxo ibe lula kumuntu ozigqokile.

Ukukhiqizwa komculo ne-podcast kusebenzisa ukuhlukanisa ukuhlukanisa amazwi ezinsimbini noma ukuqaqa i-crosstalk phakathi kwabasingathi.

Amapayipi okubona inkulumo ahlukanisa kuqala umsindo oxubile ukuze izwi ngalinye lilotshwe ngokunembile.

Amaphethini Okusebenzisa

Ukuhlukaniswa Kwenkulumo kanye Nenkinga Ye-Cocktail Party ekusebenzeni

Amathuluzi okuloba omhlangano ahlukanisa izipikha ezeqayo ukuze amagama omuntu ngamunye abalulwe ngendlela efanele kumanothi.

Amathuluzi okuloba omhlangano ahlukanisa izipikha ezigqagqene ukuze amagama omuntu ngamunye abalulwe ngendlela efanele kumanothi Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukuhlukaniswa Kwenkulumo kanye Nenkinga Ye-Cocktail Party ekusebenzeni

Izinsiza-kuzwa ezithuthukisiwe zihlukanisa isikhulumi esisodwa endaweni yokudlela egcwele abantu ukuze yenze ingxoxo ibe lula kumuntu ozigqokile.

Izinsiza-kuzwa ezithuthukisiwe zihlukanisa isikhulumi esisodwa endaweni yokudlela egcwele abantu abaningi ukuze enze ingxoxo ibe lula kumuntu ozigqokile Amathimba ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukuhlukaniswa Kwenkulumo kanye Nenkinga Ye-Cocktail Party ekusebenzeni

Ukukhiqizwa komculo ne-podcast kusebenzisa ukuhlukanisa ukuhlukanisa amazwi ezinsimbini noma ukuqaqa i-crosstalk phakathi kwabasingathi.

Ukukhiqizwa komculo ne-podcast kusebenzisa ukwahlukanisa ukuze kuhlukanise amazwi ezinsimbini noma ukuqaqa inkulumo-mpikiswano phakathi kwabasingathi Amathimba ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukuhlukaniswa Kwenkulumo kanye Nenkinga Ye-Cocktail Party ekusebenzeni

Amapayipi okubona inkulumo ahlukanisa kuqala umsindo oxubile ukuze izwi ngalinye lilotshwe ngokunembile.

Amapayipi okubona inkulumo ahlukanisa kusengaphambili umsindo oxubile ukuze izwi ngalinye libhalwe ngokunembile Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

!

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

!

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole