Uhlolojikelele
Ukumodela kolimi olufihliwe kufundisa i-AI ukuthi igcwalise amagama afihliwe ngamabomu isebenzisa umongo ogcwele ozungezile, kokubili kwesokunxele nakwesokudla. Iqhinga lokuqeqesha ngemuva kwe-BERT futhi amamodeli esizathu angaqonda ngokujulile incazelo yomusho kunokumane abikezele ukuthi yini ezayo ngokulandelayo.
Ukufanekisa Ulimi Olufihliwe kuyingxenye yesitaki solimi-AI esisetshenziselwa ukufunda, ukukhiqiza, ukuhlukanisa, nokuguqula umbhalo nenkulumo ngezikali.
I-Deep Dive
Kumodeli yolimi olufihlekile (MLM), uthatha umusho, ufihle ngokungahleliwe cishe u-15% wamathokheni awo ngophawu olukhethekile lwe-[MASK], bese uqeqesha imodeli ukuqagela okwangempela. Ngenxa yokuthi imodeli ibona amagama nhlangothi zombili zokungenalutho ngakunye, yakha ukuqonda okukabili komongo. I-BERT, yethulwa ngu-Google ngo-2018, ikwenze kwaduma lokhu. Imininingwane ehlakaniphile: ezindaweni ezimboziwe, cishe u-80% uba [MASK], u-10% ushintshaniswa ngegama elingahleliwe, futhi u-10% ushiywa ungashintshiwe. Lokhu kuvimbela imodeli ukuthi ingalindeli kuphela ithokheni ye-[MASK] ngesikhathi sokubikezela futhi kuphoqa ukuqina. Ngemva kwalokhu kuqeqeshwa kwangaphambili, imodeli ilungiselelwa kahle imisebenzi efana nokuhlukanisa, ukuphendula imibuzo, nokuqashelwa kwebhizinisi.
I-Technical Insight
I-MLM isebenzisa isishumeki seTransformer esinokuzinaka okukabili, ngakho yonke ithokheni ibheka wonke amanye ngesikhathi esisodwa. Ukulahlekelwa kubalwa kuphela ezindaweni ezifihliwe kusetshenziswa i-cross-entropy ngokumelene nama-ID wamathokheni eqiniso. Ngenxa yokuthi ukunaka akusona isizathu (akukho ukufihla ubuso esikhathini esizayo), ukumelwa kwegama ngalinye kuhlanganisa umongo kwesokunxele nowesokudla kube ivekhtha eyodwa eminyene. Lokho kuqondanisa kabili yilokho kanye amamodeli amathokheni alandelayo anikela ngakho ukuze akwazi ukukhiqiza.
Ukwenza Imodeli Yolimi Olufihliwe
Ukumodela kolimi olufihliwe kufundisa i-AI ukuthi igcwalise amagama afihliwe ngamabomu isebenzisa umongo ogcwele ozungezile, kokubili kwesokunxele nakwesokudla. Iqhinga lokuqeqesha ngemuva kwe-BERT futhi amamodeli esizathu angaqonda ngokujulile incazelo yomusho kunokumane abikezele ukuthi yini ezayo ngokulandelayo. Ukufanekisa Ulimi Olufihliwe kuyingxenye yesitaki solimi-AI esisetshenziselwa ukufunda, ukukhiqiza, ukuhlukanisa, nokuguqula umbhalo nenkulumo ngezikali. Ukuze wakhe ukuqonda okujulile, phatha i-Masked Language Modeling njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa idizayini ye-Masked Language Modeling, ukubuyisa, nokubuyekeza amaluphu njengohlelo olulodwa lokuxhumana oludidiyelwe. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana. Ngesikhathi esifanayo, amaqiniso Akhohliwe angafaka imibiko buthule, ukugeleza kosekelo, noma imiphumela yocwaningo. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana.
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Yandisa ukufinyelela kuzo zonke izilimi nezitayela zokuxhumana.
Yandisa ukufinyelela kuzo zonke izilimi nezitayela zokuxhumana. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amaqembu angachitha isikhathi esiningi ekwahluleleni kuyilapho i-automation isingatha impinda.
Amaqembu angachitha isikhathi esiningi ekwahluleleni kuyilapho i-automation isingatha impinda. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Inika amandla Google Ukusesha okusekwe ku-BERT ukuqonda kwemibuzo yengxoxo ukubuyisela amakhasi ahlobene kakhulu.
Ikhiqiza ukushumeka kwemisho kokusesha kwe-semantic kanye nezinhlelo zokubuyisa imibhalo.
I-BERT yokulungisa kahle ukuhlaziya imizwa ekubuyekezweni komkhiqizo noma amathikithi osekelo.
Ukuqashelwa okuqanjwe kwebhizinisi okukhipha abantu, izinhlangano, nezinsuku embhalweni wezomthetho noma wezokwelapha.
Amaphethini Okusebenzisa
Ukumodela Kolimi Olufihliwe kuyasebenza
Inika amandla Google Ukusesha okusekwe ku-BERT ukuqonda kwemibuzo yengxoxo ukubuyisela amakhasi ahlobene kakhulu.
Inika amandla Google Ukuqondisisa okusekelwe ku-BERT Kosesho kwemibuzo yengxoxo ukuze kubuyiselwe amakhasi ahlobene kakhulu Amathimba ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcina indlela yokukhuphuka yabantu yezigameko ezibucayi, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukumodela Kolimi Olufihliwe kuyasebenza
Ikhiqiza ukushumeka kwemisho kokusesha kwe-semantic kanye nezinhlelo zokubuyisa imibhalo.
Ukukhiqiza ukushumeka kwemisho kokusesha kwe-semantic kanye nezinhlelo zokubuyiswa kwamadokhumenti Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamacala asemaphethelweni, futhi alandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukumodela Kolimi Olufihliwe kuyasebenza
I-BERT yokulungisa kahle ukuhlaziya imizwa ekubuyekezweni komkhiqizo noma amathikithi osekelo.
I-BERT yokulungisa kahle ukuze kuhlaziywe imizwa ekubuyekezweni komkhiqizo noma amathikithi osekelo Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukumodela Kolimi Olufihliwe kuyasebenza
Ukuqashelwa okuqanjwe kwebhizinisi okukhipha abantu, izinhlangano, nezinsuku embhalweni wezomthetho noma wezokwelapha.
Ukuqashelwa okuqanjwe igama kwenhlangano ekhipha abantu, izinhlangano, nezinsuku embhalweni wezomthetho noma wezokwelapha Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka kwabantu yamacala abucayi, futhi alandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amaqiniso akhonjiwe angafaka ngokuthula imibiko, ukugeleza kosekelo, noma imiphumela yocwaningo.
Ukuzwela okusheshayo kungadala imiphumela engahambisani kuzo zonke izicelo ezifanayo.
Idatha yombhalo ebucayi ingase idalulwe uma izilawuli zokufinyelela zibuthakathaka.
Ukuqalisa Umhlahlandlela
Chaza ifomethi yokuphumayo, ithoni, namazinga wekhwalithi ngaphambi kokukhishwa.
Chaza ifomethi yokuphumayo, ithoni, namazinga wekhwalithi ngaphambi kokukhishwa. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Izimpendulo eziyisisekelo ngemithombo ethembekile noma nini lapho ukunemba kubalulekile.
Izimpendulo eziyisisekelo ngemithombo ethembekile noma nini lapho ukunemba kubalulekile. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Gcina indawo yokuhlola isibuyekezo somuntu ukuze uthole imiphumela ephezulu.
Gcina indawo yokuhlola isibuyekezo somuntu ukuze uthole imiphumela ephezulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landela amaphethini okuhluleka futhi uqeqeshe kabusha imiyalo noma ukuhamba komsebenzi njalo.
Landela amaphethini okuhluleka futhi uqeqeshe kabusha imiyalo noma ukuhamba komsebenzi njalo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.