Masked Autoencoders
Masked Autoencoders (MAE) nuburyo bwigenga bwigisha moderi yicyerekezo cyo kongera kubaka amashusho nyuma yifoto myinshi ihishe.
Incamake
By learning to fill in the blanks, the model builds rich visual understanding without any human labels.
Kwibira cyane
Masked Autoencoders, yatangijwe na Kaiming He na bagenzi be kuri Meta AI mumwaka wa 2021, fata ishusho, uyigabanyemo uduce duto, hanyuma uhishe guhisha igice kinini cyabyo, akenshi 75%. Vision Transformer encoder itunganya gusa ibice bigaragara, mugihe decoder yoroheje igerageza kubaka pigiseli yumwimerere yabuze. Kuberako byinshi byihishe, icyitegererezo ntigishobora gukoporora hafi ya pigiseli hafi kandi igomba kwiga imiterere ifatika, nkibishusho nibice byibintu. Kodegisi isimbuka ibipapuro byapanze bituma imyitozo yihuta kandi yibuka neza. Nyuma yo kwitegura, decoder irajugunywa kandi kodegisi yimura cyane imirimo yo gutondeka, gutahura, no gutandukanya.
Ubushishozi
Amayeri yingenzi ni asimmetrie: kodegisi iremereye ibona gusa 25% byapimwe, mugihe decoder ntoya yubaka ibisigaye. Ibishishwa birasibanganye, byashyizwe kumurongo, kandi bihabwa kodegisi ya posisiyo. Igihombo cyo kwiyubaka bivuze ikosa ryakorewe kubarwa gusa kubipfunyitse, mubisanzwe kuri pigiseli isanzwe. Ikigereranyo cyo hejuru cya masking gihatira kwiga semantique aho kuba interpolation yo murwego rwo hasi, no gusimbuka ibimenyetso bya maskike mugukata kodegisi bibara kuburyo butandukanye no gutunganya ishusho yuzuye.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka Masked Autoencoders
MAE-yuburyo bwa maskike yo kwiyubaka irahinduka uburyo bwo kwitegura mbere yuburyo butandukanye. Abashakashatsi barayigeza kuri videwo (guhisha umwanya wa cubes), amajwi yerekana amajwi, gusikana kwa muganga, hamwe n'amashusho ya satelite, aho ibirango ari bike kandi bihenze. Witegereze guhuza imvugo nururimi rwimikorere ya modimodal moderi, decoders ikora neza, hamwe na maskike yo guhuza n'imiterere yibasira uturere twamakuru. Mugihe compte ikura, kwipfukirana ibipapuro byerekana amashusho manini atashyizweho ikimenyetso bigomba gukomeza kunoza neza neza mugihe bigabanya gushingira kumatangazo ahenze yabantu.
Gushyira mu bikorwa Isi
Gutegura Vision Transformer kuri miriyoni y'amafoto atashyizweho ikimenyetso, hanyuma ukayitondekanya neza kugirango ImageNet ishyirwe mubikorwa hamwe nukuri.
Ibiranga imyigire ya scan yubuvuzi itemewe (X-imirasire, MRIs) aho ibisobanuro byinzobere bihenze kandi bigarukira
Guhuza uburyo na videwo muguhisha umwanya wigihe cyo kwerekana ibikorwa-kumenyekanisha ibikorwa (VideoMAE)
Kwitegura kuri satelite n'amashusho yo mu kirere kugirango ushyigikire ikarita ikoreshwa-ikarita kandi uhindure gutahura nta kirango cy'intoki
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Masked Autoencoders quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Muse Masked Amashusho Yibyara
Ibibazo bikunze kubazwa
What is Masked Autoencoders?
Masked Autoencoders (MAE) nuburyo bwigenga bwigisha moderi yicyerekezo cyo kongera kubaka amashusho nyuma yifoto myinshi ihishe. Nukwiga kuzuza ibisobanuro, icyitegererezo cyubaka imyumvire ikungahaye idafite ikirango cyabantu.
Ni ubuhe butumwa bwibanze bwo kwiyobora muri Masked Autoencoder?
MAE ihisha amashusho menshi kandi itoza icyitegererezo cyo kongera kubaka pigiseli zabuze, bisaba ko nta kirango cyabantu.
Hafi yikihe gice cyibice byamashusho MAE yumwimerere isanzwe yihishe?
Umwimerere wa MAE uhisha hafi 75% yama patch, igipimo kinini gihatira icyitegererezo kwiga imiterere ifatika aho kwigana abaturanyi.
Kuki kodegisi ya MAE itunganya gusa ibiboneka (bidafite ibimenyetso)?
Gusimbuka ibimenyetso bya mask muri kodegisi bigabanya cyane kubara no kwibuka, kubera ko ikora agace gato gusa.
Bigenda bite kuri decoder nyuma ya MAE kwitegura birangiye?
Decoder yoroheje irakenewe gusa kwiyubaka mugihe cyo kwitegura; nyuma, kodegisi yize yimura imirimo nko gutahura.
Nibihe bikorwa byigihombo MAE ikoresha muburyo bwo kwiyubaka?
MAE igabanya gusobanura ikosa ryakorewe hagati yahanuwe na pigiseli yukuri, ibarwa gusa kubipfunyitse.