Transformers Vision
Transformers (ViTs) waxay adeegsadaan qaab-dhismeedka transformer-ka ee awood u siinaya ChatGPT sawirada, iyaga oo sawirka ula dhaqmaya sidii isku xigxiga balastar halkii aad ka isticmaali lahayd shabaqyada pixels.
Dulmar
They proved that you do not need convolutions to achieve state-of-the-art image recognition.
quusid qoto dheer
Muddo sanado ah, shabakadaha neural ceerfayaasha (CNNs) ayaa xukumayay aragga kombuyuutarka iyaga oo sawiraya filtarrada yaryar ee sawirka. Waraaqda 2020 'Sawirku Wuu Istaahilaa 16x16 Erayada' oo ka yimid Google tan waxay ku xujeeyeen sawirka iyagoo gooyay dhejis go'an, caadi ahaan 16x16 pixels, oo mid walba u fidinaya vector, oo quudinaya isku xigxiga ka soo baxay beddelka caadiga ah. balastar kastaa waxa ay noqotaa 'calaamad', si aad ah sida kelmada jumlada. Qaabku wuxuu markaa adeegsadaa is-fiiro gaar ah si balastar kasta uu si toos ah ula xiriiro balastar kasta oo kale, isagoo qabsanaya cilaaqaadka fog-fog shaandhada yar ee kacaanku ma arki karto hal tallaabo. Qabashada: ViT-yadu waa gaajaysan yihiin xogta sababtoo ah waxay ka maqan yihiin malo-ku-dhisnaanta CNN-yada. Waxaa lagu tababbaray xog-ururin aad u weyn sida JFT-300M, waxay isbarbar-dhigeen ama garaaceen CNN-yada ugu wanaagsan, iyagoo dib u qaabaynaya cilmi-baarista aragga casriga ah.
Aragtida Farsamada
ViT wuxuu u kala qaybiyaa sawirka balastar aan is-dul-saarnayn, mashruucyo toos ah mid walba wuxuu gelinayaa meel-ku-xidhid, wuxuuna ku daraa cod-bixino mawqif ah si uu moodelku u ogaado meesha balastar kastaa ku fadhiistay sawirka asalka ah. Calaamad gaar ah oo la baran karo ayaa la diyaariyay; matalaaddeeda kama dambaysta ahi waxay keenaysaa kala-soocidda. Lakabyada is-fiirsashada ee is dulsaaran waxay u oggolaanayaan balastar kasta inuu ka miisaamo macluumaadka kuwa kale, isagoo siinaya meel caalami ah oo soo dhawaynaysa lakabka koowaad. Sababtoo ah feejignaantu waxay u miisaamaysaa afar-geesood tirada balastarrada, sawirada-xalinta sare waxay noqdaan kuwo qaali ah, taas oo ah sababta cabbirka balastarka iyo kala duwanaanta fiiro gaar ahaaneed ay muhiim u tahay.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Visual AI wuxuu si otomaatig ah u samayn karaa baadhista, ogaanshaha, iyo sumadaynta hawlaha miisaanka.
Xulashada dhismayaasha
Kooxaha hal-abuurka leh waxay hindise karaan fikradaha si dhakhso leh iyagoo leh dib-u-eegis buugeed yar.
Kooxda iyo socodka shaqada
Hawlgalladu waxay isticmaali karaan calaamadaha muuqaalka iyo muuqaalka kuwaas oo markii hore adkeyd in la farsameeyo.
Mustaqbalka Transformers Vision
ViTs iyo CNN-transformer hybrids hadda waxay awood u leeyihiin inay hagayaan nidaamyada aragga, iyo qaabdhismeedku waxa uu hoosta ka xarriiqaa moodooyin badan oo isku dhafan sawirada qoraalka, sida CLIP iyo caawiyayaasha luqadda aragga casriga ah. Filo shaqada sii socota ee ku saabsan ka dhigista dareenka mid ka jaban xal-sare iyo muuqaal, oo ay weheliso tababbarka is-hor-joogga ah (sida qaabaynta-sawir-ku-duubni) taas oo yaraynaysa rabitaanka cuntada ee aadka u calaamadsan. Marka kombuyuutarku kordho, xariiqda u dhaxaysa 'qaabka luqadda' iyo 'qaabka aragga' ayaa sii xumaanaya, iyada oo transformers u adeegaya sidii laf-dhabar la wadaago dhammaan hababka halkii ay kala saari lahaayeen naqshado gaar ah.
Dhaqangelinta Adduunka-dhabta ah
Google's image kala soocida iyo nidaamka qiimaynta raadinta ee qaatay laf dhabarta transformer ka dib markii ViT uu caddeeyey inuu la tartamo CNN-yada
CLIP iyo moodooyinka kale ee qoraalka-muuqaalka ah ee isticmaala ViT si loo codeeyo sawirada si sawirada iyo qoraallada la isku waafajiyo meel la wadaago
Cilmi-baarista sawir-qaadista caafimaadka iyadoo la adeegsanayo ViTs si loo ogaado qaababka guud ee skaanka halkii ay ka ahaan lahaayeen kaliya textures maxalliga ah
Is-wadidda iyo aragtida robotics-ka isku-darka dareenka qaab-dhismeedka ViT ee fahamka goobta guud ahaan goobta muuqaalka oo dhan
Khatarta & Dariiqyada Ilaalada
Xuquuqda sawirka iyo ogolaanshaha waxay noqon kartaa khataro sharci ah haddii caddayntu aanay caddayn.
Waxqabadka moodeelku wuu ku kala duwanaan karaa iftiinka, tirakoobka, iyo deegaanka.
Wanaagga beenta ah waxa laga yaabaa inaan la dareemin ilaa xadka kalsoonida aan la kormeerin.
Qorshe Hawleedka Dhaqangelinta
Qeex shuruudaha aqbalida ee saxnaanta, dib u celinta, iyo kharashyada khaladka.
Ku tijaabi xogta ku habboon xaaladaha wax soo saarka dhabta ah.
Ku dar dib u eegis bini'aadamka si aad u hesho kalsoonida hoose ama saameeynta sare.
Lasoco moodeel dhaqaaqa oo dib u cusboonaysii kamarada ama xogta kaydinta ka dib.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Vision Transformers quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
CLIP iyo Qaababka-Luuqada
Su'aalaha soo noqnoqda
What is Vision Transformers?
Transformers (ViTs) waxay adeegsadaan qaab-dhismeedka transformer-ka ee awood u siinaya ChatGPT sawirada, iyaga oo sawirka ula dhaqmaya sidii isku xigxiga balastar halkii aad ka isticmaali lahayd shabaqyada pixels. Waxay caddeeyeen inaadan u baahnayn convolutions si loo gaaro aqoonsiga muuqaalka casriga ah.
Sidee buu aragu marka hore u farsameeyaa sawirka gelinta?
ViT wuxuu u qaybiyaa sawirka balastar go'an (badanaa 16x16 pixels), wuxuu dhejiyaa balastar kasta calaamad ahaan, wuxuuna ku quudiyaa isku xigxiga transformer.
Farsamaynkee ayaa u ogolaanaya ViT inuu isku xidho qaybaha fog ee sawirka midba midka kale?
Feejignaanta nafta waxay u ogolaataa balastar kasta inuu si toos ah u miisaamo macluumaadka balastar kasta oo kale, isagoo siinaya aragti caalami ah lakabka koowaad.
Maxay tahay sababta ay Transformers-yada aragga cad caadi ahaan ugu baahan yihiin xog-ururin tababar oo aad u ballaaran si ay u wanacaan?
Si ka duwan CNN-yada, ViT-yadu uma malaynayaan in xaafad ama is-beddel tarjumaad, markaa waa inay hababkan ka bartaan tiro badan oo xog ah.
Waa maxay ujeeddada cod-bixinta booska ee ku-beddelka aragga?
Feejignaanta nafta waa nidaam-agnostic, markaa codaynta boosku waxay soo celisaa meesha bannaan ee balastar kasta.
Odhaahdee ayaa sida ugu fiican uga tarjumaysa saamaynta ViT ee aragga kombayutarka?
ViT waxay muujisay in koronto-bixiye saafi ah, oo leh xog iyo miisaan ku filan, uu la tartami karo ama ka sarre mari karo shabakadaha ugu fiican.