Buyela kuMtapowolwazi
UMHLAHLANDLELA WE-AI womsindo

I-Acoustic Scene Classification

I-Acoustic scene Classification (ASC) iqeqesha imishini ukuze ibone indawo okurekhodiwe kuyo, umgwaqo ophithizelayo, ipaki elithule, isitimela, ikhefi, ngomsindo nje.

Uhlolojikelele

I-Acoustic scene Classification (ASC) iqeqesha imishini ukuze ibone indawo okurekhodiwe kuyo, umgwaqo ophithizelayo, ipaki elithule, isitimela, ikhefi, ngomsindo nje. Inikeza amadivayisi umuzwa wokuthi 'lapho akhona' esebenzisa umsindo wodwa.

I-Acoustic Scene Classification ihlala ekuhambeni komsebenzi okulalelwayo-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.

I-Deep Dive

I-ASC icela imodeli ukuthi yabele isiqeshana somsindo esiphelele kulebula yesigcawu esisodwa kusukela ekuthunjweni okuphelele komsindo kunanoma yimuphi umcimbi owodwa. Ngokungafani nokutholwa komcimbi womsindo, obona ukukhonkotha kwenja ethile noma inhlabamkhosi, i-ASC yehlulela ingxube ye-ambient, ukuvungama, ukuphindelela, kanye nokuminyana kwemisindo egqagqene. Amasistimu aguqula okulalelwayo abe ama-spectrogram e-log-mel futhi awanikeze ama-CNN noma iziguquli zomsindo, ngokuvamile zisebenzisa ukukhuliswa kwedatha njengokuxuba kanye ne-SpecAugment ukuze kuliwe nokugcwala ngokweqile kudatha elinganiselwe. I-DCASE Challenge yaminyaka yonke iqhubekisele phambili inqubekelaphambili, ikakhulukazi ezinkingeni ezinzima njengokungafani kwedivayisi (imodeli eqeqeshelwe imakrofoni yefoni eyodwa ehluleka kwenye) nokwakha amamodeli amancane, amandla aphansi asebenza kumadivayisi asemaphethelweni.

I-Technical Insight

Ubunzima obuyinhloko ukuthi izigcawu zichazwa ngezibalo zesikhathi eside, hhayi izehlakalo zesikhashana, ngakho amamodeli ahlanganisa amasekhondi amaningi. Ukuze usinde kumadivayisi ahlukene okurekhoda, onjiniyela basebenzisa amaqhinga okujwayela isizinda kanye nokwengeza okuqaphela idivayisi okulingisa izimpendulo zemvamisa yemakrofoni. Izinhlelo eziningi eziwinayo ze-DCASE zilinganisa futhi zithene amanethiwekhi azo ukuze ahlangabezane nezabelomali zememori eqinile (imvamisa engaphansi kuka-128 KB), okufakazela ukuthi i-ASC ingasebenza kudivayisi ngaphandle kokucubungula amafu.

I-Mastering Acoustic Scene Classification

I-Acoustic scene Classification (ASC) iqeqesha imishini ukuze ibone indawo okurekhodiwe kuyo, umgwaqo ophithizelayo, ipaki elithule, isitimela, ikhefi, ngomsindo nje. Inikeza amadivayisi umuzwa wokuthi 'lapho akhona' esebenzisa umsindo wodwa. I-Acoustic Scene Classification ihlala ekuhambeni komsebenzi okulalelwayo-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-Acoustic Scene Classification njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa i-Acoustic Scene Classification aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthunyelwa. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Le-Acoustic Scene Classification

I-ASC isiba yibhilikhi kumadivayisi aqaphela umongo: izinsiza zokuzwa ezizishintsha ngokuzenzakalela endaweni yokudlela, amafoni ashintsha amaphrofayili uma ungena emotweni, kanye namakhaya ahlakaniphile aveza umsebenzi ngaphandle kwamakhamera (ukugcina ubumfihlo). Ucwaningo luphokophela ekuzivumelaniseni nezithombe ezimbalwa ezindaweni ezintsha, ukuqina kuwo wonke umbhobho, namamodeli asebenza kahle kakhulu. Ihlanganiswe nokutholwa komcimbi womsindo, i-ASC izonikeza imishini ukuqwashisa okucebile, okuqhubekayo ngendawo eyizungezile.

Ukuqaliswa Komhlaba Wangempela

Izinsiza zokuzwa ezithola indawo yokudlela enomsindo ngokumelene negumbi elithulile kanye nokulungisa ukuncishiswa komsindo ngokuzenzakalelayo

Ama-Smartphones ashintshela kuphrofayela 'yokushayela' noma 'yangaphandle' ngokusekelwe kumsindo we-ambient

Amasistimu okugcina ubumfihlo be-smart-home afaka umsebenzi wegumbi kusuka kumsindo kunevidiyo

Amathuluzi okurekhoda ne-bioacoustics amahora okurekhoda ngohlobo lwendawo yokuhlala

Amaphethini Okusebenzisa

I-Acoustic Scene Classification in practice

Izinsiza zokuzwa ezithola indawo yokudlela enomsindo ngokumelene negumbi elithulile kanye nokulungisa ukuncishiswa komsindo ngokuzenzakalelayo.

Izinsiza-kuzwa ezithola indawo yokudlela enomsindo uma ziqhathaniswa negumbi elithulile kanye nokulungisa ukuncishiswa komsindo ngokuzenzekelayo Amaqembu ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Acoustic Scene Classification in practice

Ama-Smartphones ashintshela kuphrofayela 'yokushayela' noma 'yangaphandle' ngokusekelwe kumsindo we-ambient.

Ama-smartphone ashintshela kuphrofayela 'yokushayela' noma 'yangaphandle' esekelwe kumsindo we-ambient Teams ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Acoustic Scene Classification in practice

Amasistimu okugcina ubumfihlo be-smart-home afaka umsebenzi wegumbi kusuka kumsindo kunevidiyo.

Amasistimu agcina ubumfihlo be-smart-home afaka umsebenzi wasegumbini ovela kumsindo esikhundleni sevidiyo Amathimba ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Acoustic Scene Classification in practice

Amathuluzi okurekhoda ne-bioacoustics amahora okurekhoda ngohlobo lwendawo yokuhlala.

Amathuluzi okurekhoda enkundla namathuluzi e-bioacoustics okuhlunga amahora okurekhoda ngohlobo lwendawo yokuhlala Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

!

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

!

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole

Izwi AI

Funda ukuthi amasistimu enkulumo abona futhi akhiqize kanjani ulimi.

Funda Umhlahlandlela

Umculo we-AI

Qonda amathuluzi esimanjemanje esizukulwane somculo kanye nemikhawulo.

Funda Umhlahlandlela