Abahindura Icyerekezo
Iyerekwa rya Vision (ViTs) shyira mubikorwa byububiko bihindura imbaraga ChatGPT kumashusho, ifata ishusho nkurukurikirane rwibintu aho kuba gride ya pigiseli.
Incamake
They proved that you do not need convolutions to achieve state-of-the-art image recognition.
Kwibira cyane
Kumyaka myinshi, imiyoboro ihamye (CNNs) yiganjemo iyerekwa rya mudasobwa mugusikana akayunguruzo gato ku ishusho. Urupapuro rwa 2020 'Ishusho Ifite Amagambo 16x16' kuva Google yarwanyije ibi mugukata ishusho mubice byashizweho, mubisanzwe pigiseli 16x16, gutondekanya buri kimwe muri vector, no kugaburira ibyakurikiyeho muburyo bwo guhindura ibintu bisanzwe. Buri patch iba 'ikimenyetso,' cyane nkijambo mu nteruro. Icyitegererezo noneho gikoresha kwiyitaho kugirango buri patch ishobora guhuza neza nibindi bikoresho byose, ifata umubano muremure intera ntoya yo gushungura ntishobora kubona muntambwe imwe. Ifatwa: ViTs irashonje amakuru kuko ibuze ibitekerezo byuzuye bya CNN. Bahuguwe kuri dataseti nini nka JFT-300M, bahuje cyangwa batsinze CNN nziza, bahindura ubushakashatsi bwerekanwe bugezweho.
Ubushishozi
ViT igabanya ishusho mubice bidahuzagurika, imishinga igororotse buriwese, hanyuma ikongeramo kodegisi kugirango moderi imenye aho buri patch yicaye mumashusho yumwimerere. Umwihariko wiga 'urwego rw'ikimenyetso' urategurwa; ihagararirwa ryayo rya nyuma itera ibyiciro. Gutondekanya kwiyitaho ibice reka buri patch ipime amakuru kubandi bose, itanga umurima wakira isi kuva murwego rumwe. Kuberako umunzani wokwitonderwa inshuro enye numubare wibishishwa, amashusho-y-ibishusho bihinduka bihenze, niyo mpamvu ingano yama patch hamwe nuburyo bwiza bwo kwitondera bifite akamaro.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Ejo hazaza h'abahindura icyerekezo
ViTs na CNN-transformateur ya Hybride ubu ifite imbaraga ziyobora sisitemu yo kureba, kandi ubwubatsi bushimangira moderi ya modimodal ihuza amashusho hamwe ninyandiko, nka CLIP hamwe nabafasha-bigezweho-bavuga ururimi. Witege ko uzakomeza imirimo yo gutuma ibitekerezo bihendutse kubishobora gukemurwa cyane na videwo, wongeyeho kwiyobora wenyine (nko kwerekana amashusho yerekana amashusho) bigabanya ubushake buke bwanditse. Mugihe compte ikura, umurongo uri hagati y '' imvugo y 'imvugo' n '' icyerekezo cy 'icyerekezo' ukomeza kuba urujijo, hamwe na transformateur ikora nkumugongo usangiwe muburyo butandukanye aho gutandukanya ibishushanyo byihariye.
Gushyira mu bikorwa Isi
__AIU_PROTECTED_11 __ 'ishusho yerekana amashusho hamwe na sisitemu yo gushakisha uburyo bwakoresheje imigozi ya transformateur nyuma yuko ViT yerekanye ko ihiganwa na CNNs
CLIP hamwe nandi mashusho-yerekana imiterere ikoresha ViT kugirango ushushanye amashusho kugirango amafoto nibisobanuro bishobora guhuzwa mumwanya uhuriweho
Ubuvuzi bwerekana amashusho ukoresheje ViT kugirango ubone ibishushanyo kuri scan yose aho kuba gusa imiterere yaho
Kwiyitwara wenyine hamwe na robotike yibitekerezo bihuza uburyo bwa ViT bwo kwitondera ibyerekanwe murwego rwose rwo kureba
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Vision Transformers quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
CLIP na Icyerekezo-Ururimi Icyitegererezo
Ibibazo bikunze kubazwa
What is Vision Transformers?
Iyerekwa rya Vision (ViTs) shyira mubikorwa byububiko bihindura imbaraga ChatGPT kumashusho, ifata ishusho nkurukurikirane rwibintu aho kuba gride ya pigiseli. Bagaragaje ko udakeneye imyanzuro kugirango ugere ku buhanga bugezweho bwo kumenyekanisha amashusho.
Nigute Vision Transformer yabanje gutunganya ishusho yinjiza?
ViT igabanya ishusho mubice byashizweho (akenshi pigiseli 16x16), igashyiramo buri kantu nkikimenyetso, kandi igaburira urukurikirane muri transformateur.
Ni ubuhe buryo bw'ingenzi butuma ViT ihuza ibice bya kure by'ishusho?
Kwiyitaho kureka buri patch ipima amakuru aturutse mubindi bikoresho, itanga isi yose uhereye kumurongo wambere.
Ni ukubera iki Vision Transformers isanzwe ikenera imibare nini cyane yo gutozwa kugirango ibe nziza?
Bitandukanye na CNN, ViTs ntabwo ifata aho ihindura cyangwa ihindurwa ryubuhinduzi, bityo rero bagomba kwiga ubu buryo uhereye kumubare munini wamakuru.
Niyihe ntego ya kodegisi yimyanya muri Vision Transformer?
Kwiyitaho ni gahunda-agnostic, bityo kodegisi ya posisiyo igarura umwanya wa buri patch.
Ni ayahe magambo agaragaza neza ingaruka za ViT ku iyerekwa rya mudasobwa?
ViT yerekanye ko impinduka nziza, ifite amakuru nubunini buhagije, irashobora guhangana cyangwa kurenga imiyoboro myiza yemewe.