UMHLAHLANDLELA WE-AI womsindo

Ukuqeqeshwa Okungaguquguquki Kwemvume

Ukuqeqeshwa okungaguquguquki kwe-Permutation (PIT) iqhinga lokuqeqesha elihlakaniphile elivumela imodeli ukuthi ihlukanise amazwi amaningi ngaphandle kokunaka ukuthi iphimbo eliphumayo ngalinye lingena kuphi.

2 amaminithi ukufundaIgcine ukubuyekezwa

Uhlolojikelele

It solved a stubborn labeling problem that had blocked progress in speech separation.

I-Deep Dive

Uma inethiwekhi ikhipha amazwi amabili ahlukene, awukho umthetho wemvelo lapho okukhiphayo kufanele kube 'isipikha 1' siqhathaniswa 'nesipikha 2'. Uma ukuqeqeshwa kuhlala kulindele isipikha esingu-A ekuphumeni 1, kodwa imodeli ibeka u-A kokuphumayo 2, iyajeziswa nakuba ukuhlukaniswa bekuphelele. Le 'nkinga yokuvumela ilebula' ibangele amamodeli ukuthi akhiqize okuphumayo okufiphele, okumaphakathi. Yethulwe ngu-Dong Yu kanye nozakwabo ngo-2017, i-PIT iyakulungisa ngokuzama konke ukumatanisa okungenzeka phakathi kokuphuma kwemodeli nemithombo yangempela, kuhlanganisa iphutha ngalinye, futhi kugcinwe kuphela isabelo sephutha eliphansi kakhulu ukuze kuthuthukiswe imodeli. Ngakho-ke inethiwekhi iklonyeliswa ngokuhlukana okuhlanzekile ngaphandle koku-oda, okwenza ukuqeqeshwa okungaguquki kwezikhulumi eziningi ekugcineni kusebenze.

I-Technical Insight

Esinyathelweni ngasinye sokuqeqesha, i-PIT ibala ukulahlekelwa kwazo zonke izimvume ezifanisa imiphumela ebikezelwe emithonjeni eyinkomba, bese ibuyisela emuva isebenzisa kuphela imvume yokulahlekelwa okuncane. Ezikhulumi ezimbili kukhona ukubhanqa okubili; kwezikhulumi ze-N, i-N factorial. I-PIT yezinga lokuphimisa (i-uPIT) ilungisa imvume eyodwa kukho konke ukuphimisa ukuze kugcinwe isipikha esiteshini esiphumayo esizinzile ngokuhamba kwesikhathi, igwema ukushintshashintsha kwesipikha somusho okungase kubangele isabelo sezinga lohlaka.

I-Strategic Impact

Finyelela futhi ufinyelele

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Izindleko kanye nesabelomali

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Isivinini nesikali

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Ikusasa Lokuqeqeshwa Okungaguquki Kwezimvume

I-PIT isalokhu ingumgogodla wocwaningo lokuhlukanisa, kodwa izikhombisi-ndlela ezintsha zehlisa izindleko zayo zokuhlanganisa kanye nokuhleleka okungaqondakali. Izindlela ezinjengokuhlukana okuphindaphindayo zikhipha isipikha esisodwa ngesikhathi, nezindlela zesikhulumi esiqondiwe zihoxisa imvume ngokuphelele ngokubeka isimo kuphawu lwezwi. Izikimu ze-Heuristic ne-graph-based assignment schemes zihlose ukukala i-PIT ibe yizibalo ezinkulu, eziguquguqukayo zesipikha. Lindela imibono yesitayela se-PIT ukuthi iqhubeke nomaphi lapho imodeli kufanele ikhiqize isethi engahlelekile yokuphumayo, nangaphezu komsindo.

Ukuqaliswa Komhlaba Wangempela

Ukuqeqesha amanethiwekhi e-neural ukuze ahlukanise izipikha ezimbili noma ngaphezulu ezidlulanayo ekurekhodweni komhlangano nokushaya ucingo.

Inika amandla amasistimu okuhlukanisa imakrofoni eyodwa asetshenziswa njengesiphetho esiphambili sokubonwa kwenkulumo.

Ivumela i-PIT yezinga lokuphimisa ukuze igcine isipikha ngasinye sabelwe isiteshi esiphumayo esingaguquki kuyo yonke ingxoxo.

Isebenza njengenhloso yokuqeqeshwa kumamodeli okuhlukaniswa kwebhentshimakhi ahlolwe kumadathasethi afana ne-WSJ0-2mix.

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Qhubeka Uhlole

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Permutation Invariant Training quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Qala imibuzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Umhlahlandlela olandelayo

Ukuqeqeshwa kwe-AI

Imibuzo evame ukubuzwa

What is Permutation Invariant Training?

Ukuqeqeshwa okungaguquguquki kwe-Permutation (PIT) iqhinga lokuqeqesha elihlakaniphile elivumela imodeli ukuthi ihlukanise amazwi amaningi ngaphandle kokukhathalela ukuthi iphimbo eliphumayo ngalinye lifika phakathi. Kuxazulule inkinga yokulebula enenkani ebivimbe ukuqhubeka ekuhlukaniseni inkulumo.

Iyiphi inkinga esemqoka exazululwa yi-permutation invariant training (PIT)?

I-PIT ibhekana nenkinga yokuvumela ilebula: asikho isizathu esingokwemvelo esiphumayo esithi 1 kufanele kube isipika A kunesipikha esingu-B.

I-PIT inquma kanjani ukuthi yiliphi iphutha okufanele lisetshenziswe lapho kubuyekezwa imodeli?

I-PIT ihlola ukulahlekelwa kwemvume ngayinye engenzeka futhi ibuyisele emuva umsebenzi ozokwenziwa wokulahlekelwa okuncane kuphela.

Ngaphandle kwesixazululo esifana ne-PIT, yini ejwayele ukwenzeka emiphumeleni yemodeli yokuhlukanisa?

Ukulebula okungahambisani kuthumele ama-gradient angqubuzanayo, aphushela imodeli ekulinganiseni okumaphakathi, okugcotshiwe kwezipikha.

Ukuze uhlukanise izipikha ze-N, zingaki izimvume okufanele i-PIT icabangele isinyathelo ngasinye?

Bakhona N! izindlela zokunikeza imiphumela engu-N emithonjeni engu-N, yingakho ukukala i-PIT kuzipikha eziningi kubiza kakhulu.

Iyiphi inzuzo engeza i-PIT yeleveli yokukhuluma (uPIT) ngaphezu komsebenzi ozokwenziwa weleveli?

I-UPIT ilungisa imvume eyodwa kukho konke ukuphimisa, ivimbela izikhulumi ekushintsheni iziteshi maphakathi nomusho.