DINO Ntugharị onwe
DINO bụ usoro na-ahụ maka onwe ya nke na-azụ ihe ntụgharị ọhụụ iji ghọta ihe oyiyi na-enweghị akara ọ bụla, site n'inwe netwọk na-akụzi onwe ya.
Nchịkọta
It produces features so clean that object boundaries emerge for free in the attention maps.
Ime miri emi
DINO, dị mkpụmkpụ maka nhụsianya onwe onye na-enweghị akara, nke Meta AI (mgbe ahụ Facebook AI) bipụtara na 2021. Ọ na-eji mbipụta abụọ nke otu netwọk - nwa akwụkwọ na onye nkụzi - ma na-azụ ha ihe ọkụkụ dị iche iche agbakwunyere nke otu ihe oyiyi. Nwa akwụkwọ ahụ na-anwa ime ka nkesa nke onye nkuzi dakọtara, n'agbanyeghị na onye nkuzi na-ahụ naanị echiche dị iche. N'ụzọ dị mkpa, a na-azụghị onye nkụzi ahụ kpọmkwem; ịdị arọ ya bụ nkezi na-akpụ akpụ nke nwa akwụkwọ, ji nwayọọ nwayọọ na-eso ya. Iji kwụsị netwọk ahụ ka ọ ghara ịdaba na otu azịza mgbe niile, DINO na-emepe ma na-amụba nsonaazụ onye nkụzi. Nsonaazụ dị ịrịba ama bụ na maapụ nlebara anya nke ihe ngbanwe ọhụụ na-esi na ya pụta na-aghọ ihe na-enweghị mgbe a gwara ya ihe bụ ihe.
Nghọta nka nka
Netwọk abụọ ahụ na-emepụta nkesa puru omume dị elu mgbe softmax gasịrị. Nwa akwụkwọ ahụ na-ahụ obere ihe ọkụkụ mpaghara gbakwunyere echiche zuru ụwa ọnụ, ebe onye nkuzi na-ahụ naanị echiche zuru ụwa ọnụ - usoro ihe ọkụkụ dị iche iche nke na-akwalite nkwụsi ike mpaghara na ụwa. Ọnwụ ahụ bụ cross-entropy n'etiti nkesa nke onye nkuzi na ụmụ akwụkwọ, yana gradients na-agafe naanị site na nwa akwụkwọ ahụ. Aghụghọ abụọ na-egbochi ndakpọ: ileba anya na-ewepụ ihe na-agba ọsọ n'aka ndị nkuzi logits, na obere okpomọkụ na-amụba ha, na-eme ka ibe ha guzozie ka ihe pụta na-adị iche.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke DINO Ntugharị Onwe Ya
DINO malitere usoro ọrụ dị mkpa. DINov2 (2023) webatara uzommeputa ahụ ruo ihe karịrị otu ijeri onyonyo echekwabara, na-enye atụmatụ nlebara anya niile nke ndị ndoro-ndoro anya n'ụdị nleba anya gafee nleba anya miri emi, nkewa, na iweghachite - enwere ike iji ya na-enweghị ezigbo ndozi. Na-atụ anya nhụsianya onwe ka ọ ga-adị n'etiti ka ubi na-achụso ụdị ntọala na-enweghị akara maka ọhụụ, robotics, na usoro ọtụtụ, ebe nkọwa dị oke ọnụ. Ngwongwo-nkewa nke emelitere na-emekwa ka nyocha na-akpali akpali n'ime nghọta okwu nwere ike imeghe.
Mmejuputa n'ezie n'ụwa
Nkewa ihe anaghị elekọta ya, ebe maapụ uche DINO na-akọwapụta ihe na-enweghị akara nkpuchi ọ bụla.
Iweghachite onyonyo na nchọta nnomi, na-eji njirimara DINO chọta onyonyo nso oyiri ma ọ bụ nke yiri ya
Njirimara DINov2 dị ka ọkpụkpụ azụ oyi kpọnwụrụ maka ntule omimi na nnukwu amụma ọrụ
Ịmalite ọzụzụ ahụike ma ọ bụ ụdị ọhụụ satịlaịtị ebe akara data dị ụkọ ma ọ bụ ọnụ ahịa
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DINO Self-Distillation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
DreamFusion na Nlele Distillation Score
Ajụjụ a na-ajụkarị
What is DINO Self-Distillation?
DINO bụ usoro na-ahụ maka onwe ya nke na-azụ ihe ntụgharị ọhụụ iji ghọta ihe oyiyi na-enweghị akara ọ bụla, site n'inwe netwọk na-akụzi onwe ya. Ọ na-emepụta atụmatụ dị ọcha nke na oke ihe na-apụta n'efu na maapụ nlebara anya.
Kedu ihe 'NO' na DINO pụtara?
DINO pụtara ntugharị onwe ya na-enweghị akara - ọ na-ahụ maka onwe ya nke ọma, na-achọghị nkọwa mmadụ.
Kedu otu esi emelite nha netwọkụ onye nkuzi na DINO?
Onye nkuzi bụ EMA nke nwa akwụkwọ ahụ, yabụ ọ na-agbaso nwa akwụkwọ ahụ nke ọma karịa ka a zụrụ ya ozugbo.
Kedu nsogbu ịtinye n'isi na ịdị nkọ nke nsonaazụ onye nkuzi na-egbochi?
Ịme n'otu n'otu na ịdị nkọ na-emegiderịta onwe ya iji mee ka ihe ndị nkụzi pụta dị iche iche, na-ezere ngwọta na-adịghị mkpa mgbe niile.
N'ime atụmatụ mkpụrụ osisi dị iche iche nke DINO, kedu echiche onye nkuzi na-enweta?
Onye nkuzi na-ahụ naanị ihe ọkụkụ zuru ụwa ọnụ ebe nwa akwụkwọ ahụ na-ahụkwa obere ihe ọkụkụ mpaghara, na-agba ume ka mpaghara na-agbanwe agbanwe.
Kedu ihe na-eju anya na-apụta na maapụ nlebara anya nke mgbanwe ọhụụ nke DINO zụrụ?
Nlebara anya nke DINO na-egosipụtakarị oke ihe, na-eme nkewa n'agbanyeghị na ọ naghị ahụ ihe mkpuchi.