Kwigenzura wenyine
Kwigenzura wenyine-yiga atoza icyitegererezo kumakuru atanditse muguhimba umurimo igisubizo cyihishe mumibare ubwayo.
Incamake
It is how modern language and vision foundation models learn from the raw internet without armies of human labelers.
Kwibira cyane
Kwandika amakuru kubiganza biratinda kandi bihenze, nyamara isi yuzuyemo inyandiko, amashusho, amajwi, na videwo. Kwigenzura wenyine kwifungura mugukora 'urwitwazo rwakazi' aho amakuru atanga igisubizo cyayo. The classic example is masked language modeling, used by BERT: hide some words in a sentence and train the model to predict them from context. Imiterere ya GPT iteganya ijambo rikurikira. Mu iyerekwa, uburyo butandukanye nka SimCLR bwerekana icyitegererezo ibihingwa bibiri byongerewe ishusho imwe kandi bikigisha ko ari hamwe mugihe cyo gutandukanya amashusho atandukanye. Solving these self-made puzzles forces the model to build rich internal representations of meaning and structure. Those representations then transfer powerfully to real downstream tasks with little or no labeled data.
Ubushishozi
Amayeri atanga ibimenyetso byo kugenzura kubuntu. Mu kwerekana icyitegererezo, ikimenyetso cyihishe ni ikirango, igihombo rero gishobora kubarwa nta bisobanuro byabantu. Mu myigire itandukanye, kwiyongera kwishusho imwe bigize 'couple nziza' igomba kwicara hafi yo gushyiramo umwanya, mugihe andi mashusho ari 'negatif' yasunitswe kure. Inzira zose, icyitegererezo cyashyizwe hejuru kubirango biva gusa muburyo bwimiterere yamakuru, biga ibintu rusange nyuma bikenera gusa urumuri rwiza.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Igihe kizaza cyo Kwigenzura wenyine
Kwigenzura wenyine ni moteri inyuma yicyitegererezo cyumunsi, kandi urwo ruhare ruzakura gusa. Icyerekezo gisobanutse kijyanye no kwimenyekanisha kuri multimodal, aho icyitegererezo kimwe cyigira hamwe uhereye kumyandiko, amashusho, amajwi, na videwo ukoresheje intego zo kwiyobora. Abashakashatsi barimo gusunika ibirenze uburyo butandukanye bwo kwerekana uburyo bwo guhanura mu buryo bwo kureba no tekinike yo kwikuramo bidakeneye ingero mbi. Nkuko amakuru yo mu rwego rwohejuru yanditswemo ahinduka icyuho, kwiga imiterere yingirakamaro biturutse kumigezi minini itashyizweho ikimenyetso bizakomeza kuba ingamba nkuru yo gupima AI.
Gushyira mu bikorwa Isi
BERT yiga ururimi mu guhanura amagambo yapfunditswe, hanyuma utegure neza gushakisha, amarangamutima, cyangwa gusubiza ibibazo
SimCLR yerekana kodegisi yifoto kumafoto atashyizweho ikimenyetso kugirango irashobora gutondekanya hamwe na labels nkeya
Imiterere ya GPT yiga kwandika mukuvuga inshuro nyinshi ikimenyetso gikurikira hejuru yinyandiko nini corpora
Moderi yimvugo yabanjirijwe kumajwi mbisi adashyizweho ikimenyetso (guhanura ibice byijwi byanditseho amajwi) mbere yo guhuza na transcript
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Kwigenzura-Kwiga bifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Self-Supervised Learning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kugenzura Kwiga
Ibibazo bikunze kubazwa
What is Self-Supervised Learning?
Self-supervised learning trains models on unlabeled data by inventing a task whose answer is hidden inside the data itself. Nuburyo imvugo igezweho nicyerekezo fatizo bigira kuri internet mbisi idafite ingabo zabantu.
Niki gituma kwiga 'kwiyobora'?
Kwiga kugenzurwa no guhimba umurimo urwitwazo aho igisubizo cyihishe mumibare, kubwibyo rero nta kirango cyabantu gikenewe.
Ni ukubera iki kwigira wenyine kwigira bifite agaciro kubwicyitegererezo?
Kuberako ibimenyetso byubugenzuzi biva mumibare ubwayo, moderi irashobora gutegurwa kuri corpora nini itanditse kurubuga.
Nyuma yo kwiyobora wenyine, mubisanzwe bigenda bite nyuma?
Gutegura byubaka ibyerekanwe muri rusange byimura neza, gusa urumuri rwiza-kuringaniza amakuru yanditseho rukenewe kubikorwa byihariye.
Nigute uburyo bwa GPT-moderi yimikorere yiyobora itandukanye na BERT?
Imiterere ya GPT yatojwe guhanura ibimenyetso bizakurikiraho, mugihe BERT ihanura ibimenyetso byapfunditswe ukoresheje ibumoso n'iburyo.