BYOL na nlekọta onwe onye na-adịghị agbanwe agbanwe
BYOL (Bootstrap Your Own Latent) na-amụta ihe ngosi onyonyo bara uru na-enweghị akara ọ bụla yana, ihe ijuanya, na-enweghị atụ na-adịghị mma.
Nchịkọta
It showed that self-supervised learning need not rely on pushing apart dissimilar images, sidestepping the need for huge batches of negatives.
Ime miri emi
Ọtụtụ ụzọ a na-elekọta onwe ha n'oge dị iche iche: ha na-adọta echiche abụọ agbakwunyere nke otu ihe oyiyi ọnụ mgbe ha na-akwagharị ihe oyiyi dị iche iche, nke chọrọ ọtụtụ ihe nlele na-adịghị mma iji zere ịdaba (ebe netwọk na-emepụta otu vector maka ihe ọ bụla). BYOL, site na DeepMind na 2020, wepụrụ ihe ọjọọ kpamkpam. Ọ na-eji netwọk abụọ: netwọk ịntanetị na netwọk lekwasịrị anya. Echiche abụọ agbakwunyere nke otu onyonyo na-agafe na netwọkụ abụọ ahụ; netwọkụ dị n'ịntanetị na-agbakwunye isi amụma ma zụọ ya ka ọ buru amụma nnochite anya netwọkụ ezubere iche nke echiche nke ọzọ. N'ụzọ dị egwu, ọ bụghị n'usoro mgbada gradient zụrụ nha netwọk ndị ezubere iche. Kama, ha bụ nkezi na-agagharị agagharị (EMA) nke ịdị arọ ịntanetị. Asymmetry a gbakwunyere ebumnuche EMA na-egbochi ụzọ ndakpọ dị obere na-atụ egwu, dakọtara ma ọ bụ tie ihe ndabere dị iche na ImageNet.
Nghọta nka nka
Ngwakọta atọ na-akwụsị ịdaba na-enweghị ihe ọjọọ: MLP mgbakwunye amụma na ngalaba ịntanetị, nkwụsị-gradient na alaka ebumnuche, yana ebumnuche emelitere EMA. Ebumnuche ahụ na-arụ ọrụ dị ka ihe mgbaru ọsọ na-emegharị nwayọọ nwayọọ na-emegharị, ya mere netwọk ịntanetị na-achụso ihe kwụsiri ike, ebumnobi na-adịghị ala ala kama ịbụ onye na-emegharị onwe ya. Asymmetry nke onye amụma na-agbaji akara ngosi nke ga-eme ka alaka abụọ ahụ pụta obere oge. Batch normalization na projector na-atụnyekwa aka n'usoro nhazi nke ọma.
Mmetụta atụmatụ
Ọnụ ego na mmefu ego
Mkpebi ihe owuwu ụlọ na-akwalite arụmọrụ yana ọnụ ahịa ọrụ ruo ọtụtụ afọ.
Mkpebi doro anya
Nkà mmụta nka na-enyere ndị otu egwuregwu aka ịhọrọ nchịkọta ziri ezi, ọ bụghị naanị nke kachasị ọhụrụ.
Quality akara
Nhọrọ injinia ka mma na-ebelata ihe omume ntụkwasị obi na mmepụta.
Ọdịnihu nke BYOL na nlekọta onwe onye na-adịghị agbanwe agbanwe
Echiche ndị na-enweghị mgbagha ugbu a na-akwado ọtụtụ ọhụụ nke onye na-elekọta onwe ya. SimSiam wepụrụ BYOL n'ihu, na-egosi ebumnuche EMA achọghị nke ọma ma ọ bụrụ na edobere nkwụsị gradient, nghọta miri emi nke ihe kpatara eji zere ọdịda. Na-atụ anya na usoro nkuzi izizi na-enweghị akara ka ga-ejikọta ya na ụdị ihe nkpuchi na ọzụzụ multimodal, yana ịgbasa na vidiyo, ọdịyo, onyonyo ahụike, na robotik ebe akara ngosi dị ụkọ ma ọ bụ dị ọnụ ahịa, na-abụkarị ọkwa ọzụzụ tupu a na-elekọta ya nke ọma.
Mmejuputa n'ezie n'ụwa
Ịmalite ọkpụkpụ azụ ọhụụ n'ọtụtụ nde foto ndị na-enweghị aha, na-emezigharị nke ọma na obere ihe onyonyo onyonyo ahụike akpọrọ ebe nkọwa ndị ọkachamara dị ụkọ.
Ịmụ atụmatụ nghọta robot site na iyi igwefoto raw na-enweghị akara aka, na-ebelata ọnụ ahịa nkuzi ọrụ aghụghọ.
Ewuweghachi onyonyo na sistemu mwepu site na iji ntinye BYOL na-achịkọta onyonyo yiri nke ahụ na-enweghị akara klaasị ọ bụla.
Ịmalite ụdị onyonyo nke satịlaịtị ma ọ bụ ikuku n'ime nnukwu ebe nchekwa na-enweghị akara tupu emezigharị nke ọma maka nhazi ala ma ọ bụ igbutu ọhịa.
Ihe ize ndụ & okporo ụzọ nche
Ịkwalite otu akara ngosi nwere ike zoo adịghị ike sistemụ sara mbara.
A na-eledakarị ihe akụrụngwa na ụgwọ ọrụ anya.
Ọdịiche nchekwa na nleba anya nwere ike itolite ka sistemu na-adịwanye mgbagwoju anya.
Map mmejuputa
Kọwaa latency, ịdịmma na ebumnuche ọnụ ahịa tupu mmejuputa ya.
Benchmark n'okpuru ibu dị adị na ọnọdụ data.
Nleba anya akụrụngwa maka mperi, ịkpafu na mmetụta onye ọrụ.
Kwadebe ụzọ nzaghachi azụghachi azụ na ihe omume tupu ịchachaa.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the BYOL and Non-Contrastive Self-Supervision quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ịkpọ aha ụgha na ọzụzụ onwe
Ajụjụ a na-ajụkarị
What is BYOL and Non-Contrastive Self-Supervision?
BYOL (Bootstrap Your Own Latent) na-amụta ihe ngosi onyonyo bara uru na-enweghị akara ọ bụla yana, ihe ijuanya, na-enweghị atụ na-adịghị mma. O gosiri na mmụta nke onwe ya ekwesịghị ịdabere n'ịchụpụ ihe oyiyi ndị dị iche iche, na-ewepụ mkpa ọ dị maka nnukwu ihe na-adịghị mma.
Kedu ihe na-eme BYOL ka ọ dị iche n'etiti usoro nlekọta onwe ya nke oge ya?
BYOL gosipụtara mmụta nnochi anya siri ike ga-ekwe omume na-enweghị ụzọ abụọ na-adịghị mma, na-agbasa site na ụzọ dị iche iche.
Kedu otu esi emelite nha netwọọdụ ebumnuche na BYOL?
Netwọk ebu n'obi bụ EMA (nṅomi na-eji nwayọ) nke netwọkụ ịntanetị na-esiteghị na mgbada gradient zụrụ ya.
Olee nsogbu ndị mmadụ na-atụ egwu na ọ ga-eme mgbe ha na-ewepụ ihe ndị na-adịghị mma, gịnịkwa mere o ji dị mkpa?
Na-enweghị ihe ndị na-adịghị mma, nhazi naive nwere ike ịdaba na mmepụta mgbe niile; Nhazi BYOL na-egbochi nke a.
Kedu akụrụngwa etinyere naanị na ngalaba ịntanetị iji mebie symmetry?
Alaka dị n'ịntanetị nwere isi amụma amụma ọzọ; asymmetry ọ na-emepụta bụ isi ihe na-ezere ọdịda.
Kedu ihe netwọk ịntanetị a zụrụ n'ezie ime?
BYOL na-ebelata ọdịiche dị n'etiti amụma ịntanetị yana nnochite anya nke ọzọ.