Ukufunda Okuzigadile
Ukufunda okuzigadile kuqeqesha amamodeli kudatha engenamalebula ngokusungula umsebenzi impendulo yawo efihliwe ngaphakathi kwedatha ngokwayo.
Uhlolojikelele
It is how modern language and vision foundation models learn from the raw internet without armies of human labelers.
I-Deep Dive
Ukulebula idatha ngesandla kuhamba kancane futhi kuyabiza, nokho umhlaba ugcwele umbhalo, izithombe, umsindo, nevidiyo engenamalebula. Ukufunda okuzigadile kuyakuvula ngokwakha 'imisebenzi yokuzazisa' lapho idatha inikeza impendulo yayo. Isibonelo sakudala ukumodela kolimi olufihlekile, olusetshenziswa i-BERT: fihla amagama athile emshweni futhi uqeqeshe imodeli ukuwabikezela kumongo. Amamodeli esitayela se-GPT abikezela igama elilandelayo. Embonweni, izindlela ezihlukile ezifana ne-SimCLR zibonisa imodeli yezitshalo ezimbili ezithuthukisiwe zesithombe esifanayo futhi ziyifundise ukuthi zihlangene ngenkathi zihlukanisa izithombe ezihlukene. Ukuxazulula lezi zindida ezizenzele zona kuphoqa imodeli ukuthi yakhe izethulo ezinothile zangaphakathi zencazelo nesakhiwo. Lezozethulo zibe sezidlulisa ngamandla emisebenzini yangempela eya phansi enedatha encane noma engenawo ilebula.
I-Technical Insight
Iqhinga likhiqiza isignali yokugada mahhala. Kumodeli efihliwe, ithokheni efihliwe ilebula, ngakho ukulahlekelwa kungabalwa ngaphandle kwanoma yisiphi isichasiselo somuntu. Ekufundeni okuphambene, ukukhuliswa okubili kwesithombe esisodwa kwakha 'ipheya elungile' okufanele ihlale eduze ekushumekeni isikhala, kuyilapho ezinye izithombe 'zingezibi' ziphushwa. Kunoma ikuphi, imodeli ithuthukiswe kumalebula athathwe ngokuphelele esakhiweni sedatha ngokwayo, ukufunda izici ezivamile kamuva ezidinga ukulungiswa kahle kokukhanya.
I-Strategic Impact
Izinqumo ezicacile
Kukusiza ukuthi uhlukanise izimangalo ezicacile zobuchwepheshe kusukela olimini lokumaketha.
Izindleko kanye nesabelomali
Ungabuza imibuzo yokusebenzisa kangcono ngaphambi kokusebenzisa imali noma isikhathi.
Ithimba kanye nokusebenza komsebenzi
Amaqembu anokuqonda okwabiwe enza izinqumo ezingcono zomkhiqizo, inqubomgomo, nokufunda.
Ikusasa Lokufunda Ngokuzigada
Ukufunda okuzigadile kuyinjini engemuva kwamamodeli esisekelo sanamuhla, futhi leyo ndima izokhula kuphela. Ithrendi ecacile imayelana nokuqeqeshwa kwangaphambili kwe-multimodal, lapho imodeli eyodwa ifunda ngokuhlanganyela embhalweni, izithombe, umsindo, nevidiyo isebenzisa izinjongo ezizigadayo. Abacwaningi badlulela ngalé kwezindlela ezingafaniyo bebheke ezindleleni zokubikezela okufihlekile embonweni nezindlela zokuzihluza ezingadingi izibonelo ezingezinhle. Njengoba idatha enelebula yekhwalithi ephezulu iba ibhodlela, ukufunda isakhiwo esiwusizo ngokuqondile emifudlaneni emikhulu engenamalebula kuzohlala kuyisu elimaphakathi lokukala i-AI.
Ukuqaliswa Komhlaba Wangempela
I-BERT yokufunda ulimi ngokubikezela amagama afihliwe, bese alungiselelwa ukusesha, imizwa, noma ukuphendula imibuzo
I-SimCLR iqeqesha kusengaphambili isishumeki sesithombe ezithombeni ezingalebuli ukuze kamuva sihlukanise ngamalebula ambalwa kakhulu
Amamodeli esitayela se-GPT afunda ukubhala ngokubikezela ngokuphindaphindiwe ithokheni elandelayo kuyo yonke imibhalo emikhulu
Amamodeli enkulumo aqeqeshwe kusengaphambili kumsindo ongahluziwe ongalebuli (ukubikezela izingxenye zomsindo ofihliwe) ngaphambi kokujwayelaniswa nokulotshiwe
Izingozi & Guardrails
Amaqembu ahlukene angasebenzisa igama elifanayo ngokuhlukile, ngakho chaza ububanzi kusenesikhathi.
Amabhentshimakhi angabukeka eqinile kuyilapho ukusebenza komhlaba wangempela kungalingani.
Ukuziba ikhwalithi yedatha nezinhlelo zokuhlaziya kuvame ukudala imiphumela entekenteke.
Ukuqalisa Umhlahlandlela
Qala ngencazelo yolimi olulula yomphumela oyidingayo.
Khetha imethrikhi eyodwa yempumelelo nesimo esisodwa sokuhluleka ngaphambi kokuhlolwa.
Qalisa umshayeli omncane onedatha emele, hhayi isethi yedemo ephucuziwe.
Bhala lapho Ukufunda Ukuzigada kusiza nalapho izindlela ezilula zingcono.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Self-Supervised Learning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukufunda Okugadiwe
Imibuzo evame ukubuzwa
What is Self-Supervised Learning?
Ukufunda okuzigadile kuqeqesha amamodeli kudatha engenamalebula ngokusungula umsebenzi impendulo yawo efihliwe ngaphakathi kwedatha ngokwayo. Kuyindlela amamodeli esisekelo solimi lwesimanjemanje afunda ngayo ku-inthanethi engaphekiwe ngaphandle kwamabutho abantu ababhala ilebula.
Yini eyenza ukufunda kube 'kuzigada'?
Ukufunda ukuzigadile kusungula umsebenzi wokuzazisa lapho impendulo ifihliwe kudatha, ngakho-ke akukho malebula omuntu adingekayo.
Kungani ukufunda ukuziqondisa kubaluleke kangaka kumamodeli ayisisekelo?
Ngenxa yokuthi isignali yokugada ivela kudatha ngokwayo, amamodeli angaqeqeshwa kusengaphambili kunkampani enkulukazi engenamalebula evela kuwebhu.
Ngemva kokuziqeqesha kusengaphambili, yini evame ukwenzeka ngokulandelayo?
Ukuqeqeshwa kwangaphambili kwakha izethulo ezijwayelekile ezidlulisa kahle, ngakho ukulungisa ukukhanya kuphela kudatha enelebula edingekayo emisebenzini ethile.
Ingabe umsebenzi wokuzigada wemodeli yesitayela se-GPT uhluke kanjani koka-BERT?
Amamodeli esitayela se-GPT aqeqeshelwe ukubikezela ithokheni elandelayo ngokulandelana, kuyilapho i-BERT ibikezela amathokheni amboziwe esebenzisa kokubili umongo kwesokunxele nakwesokudla.