BYOL hamwe no Kutavuguruzanya Kwigenzura
BYOL (Bootstrap Own Latent) yiga amashusho yingirakamaro nta kirango na kimwe, kandi, igitangaje, nta ngero mbi.
Incamake
It showed that self-supervised learning need not rely on pushing apart dissimilar images, sidestepping the need for huge batches of negatives.
Kwibira cyane
Uburyo bwinshi bwo kwiyobora hakiri kare bwari butandukanye: bakwega ibitekerezo bibiri byongeweho ishusho imwe hamwe mugihe basunikaga amashusho atandukanye, byasabye ingero nyinshi mbi kugirango birinde gusenyuka (aho umuyoboro usohora vector imwe kuri buri kintu). BYOL, kuva muri DeepMind muri 2020, yakuyeho ibibi rwose. Ikoresha imiyoboro ibiri: umuyoboro wa interineti numuyoboro ugamije. Ibintu bibiri byongerewe ishusho imwe inyura mumiyoboro ibiri; umuyoboro wa interineti wongeyeho umutwe wo guhanura kandi watojwe guhanura intego yibikorwa byerekana ubundi buryo bwo kureba. Icyitonderwa, ibipimo byurwego rwibipimo ntabwo byatozwa na gradient descente. Ahubwo ni impuzandengo yimuka (EMA) yuburemere kumurongo. Iyi asimmetrie wongeyeho intego ya EMA irinda gusenyuka kworoheje uburyo butandukanye bwo gutinya, guhuza cyangwa gukubita ibice bitandukanye kuri ImageNet.
Ubushishozi
Ibintu bitatu bihagarika gusenyuka nta ngaruka mbi: byongeye guhanura MLP ku ishami rya interineti, guhagarara-buhoro ku ishami ryerekanwe, hamwe na EMA ivugururwa. Intego ikora nkintego igenda isubira inyuma buhoro buhoro, bityo umuyoboro wa interineti ukurikirana intego ihamye, itinda aho kuba kopi yimuka ubwayo. Asimmetrie ya predictor isenya simmetrie ubundi ikareka amashami yombi agasohora bito bihoraho. Gufata ibisanzwe muri umushinga nabyo bigira uruhare muburyo busanzwe.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza ha BYOL no Kutavuguruzanya Kwigenzura
Ibitekerezo bitavuguruzanya ubungubu ibyerekezo byinshi byo kwiyobora. SimSiam yambuye BYOL hasi, yerekana intego ya EMA ntabwo isabwa cyane niba guhagarika-gradient bikomeje, byimbitse gusobanukirwa nimpamvu yo gusenyuka birindwa. Tegereza ibyo bitabo bitarimo ibirango byo kwitegura kugirango ukomeze guhuza hamwe no kwerekana amashusho yerekana amashusho hamwe namahugurwa ya multimodal, no gukwirakwira kuri videwo, amajwi, amashusho yubuvuzi, hamwe na robo aho ibirango ari bike cyangwa bihenze, akenshi nkicyiciro cyo kwitegura mbere yumucyo ukurikiranwa neza.
Gushyira mu bikorwa Isi
Gutegura umugongo w'icyerekezo kuri miriyoni y'amafoto atashyizweho ikimenyetso, hanyuma ugahuza neza kuri dataset ntoya yanditseho ubuvuzi-bwerekana amashusho aho ibisobanuro byinzobere ari bike.
Kwiga robot yibiranga kuva kamera ya kamera mbisi nta kuranga intoki, kugabanya ikiguzi cyo kwigisha imirimo ya manipulation.
Kubaka amashusho-kugarura no kugabanya sisitemu ukoresheje BYOL yashyizwemo ayo mashusho asa nkaho nta kirango cyicyiciro.
Gutangiza icyogajuru cyangwa amashusho yikirere mububiko bunini butanditseho ububiko mbere yo guhuza neza imikoreshereze yubutaka cyangwa gutema amashyamba.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the BYOL and Non-Contrastive Self-Supervision quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Pseudo-Kwandika no Kwitoza
Ibibazo bikunze kubazwa
What is BYOL and Non-Contrastive Self-Supervision?
BYOL (Bootstrap Own Latent) yiga amashusho yingirakamaro nta kirango na kimwe, kandi, igitangaje, nta ngero mbi. Yerekanye ko kwigira wenyine kwigira bidakeneye gushingira ku gutandukanya amashusho atandukanye, ukuraho ibikenewe byinshi bibi.
Niki gituma BYOL itandukana muburyo bwigenga bwigihe cyayo?
BYOL yerekanye imbaraga zo guhagararira kwiga birashoboka nta jambo ribi, uciye muburyo butandukanye.
Nigute uburemere bwurwego rwibipimo bigezweho muri BYOL?
Umuyoboro ugamije ni EMA (kopi-igenda buhoro) y'urusobe rwa interineti kandi ntabwo yatojwe na gradient descente.
Ni ikihe kibazo abantu batinyaga ko cyabaho mugihe cyo gukuraho ibibi, kandi kuki bifite akamaro?
Hatariho ibibi, naive setup irashobora gusenyuka kumusaruro uhoraho; Igishushanyo cya BYOL kirinda ibi.
Nibihe bice byongewe gusa kumashami kumurongo kugirango bisenye?
Ishami rya interineti rifite umutwe wongeyeho; asimmetrie ikora ni urufunguzo rwo kwirinda gusenyuka.
Niki umuyoboro wa interineti watojwe gukora?
BYOL igabanya itandukaniro riri hagati yo guhanura kumurongo hamwe nintego yo kwerekana ikindi gitekerezo.