Amabwiriza ya AI

Masked Autoencoders

Masked Autoencoders (MAE) nuburyo bwigenga bwigisha moderi yicyerekezo cyo kongera kubaka amashusho nyuma yifoto myinshi ihishe.

Incamake

Masked Autoencoders (MAE) nuburyo bwigenga bwigisha moderi yicyerekezo cyo kongera kubaka amashusho nyuma yifoto myinshi ihishe. Nukwiga kuzuza ibisobanuro, icyitegererezo cyubaka imyumvire ikungahaye idafite ikirango cyabantu.

Masked Autoencoders niyibikorwa bya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga.

Kwibira cyane

Masked Autoencoders, yatangijwe na Kaiming He na bagenzi be kuri Meta AI mumwaka wa 2021, fata ishusho, uyigabanyemo uduce duto, hanyuma uhishe guhisha igice kinini cyabyo, akenshi 75%. Vision Transformer encoder itunganya gusa ibice bigaragara, mugihe decoder yoroheje igerageza kubaka pigiseli yumwimerere yabuze. Kuberako byinshi byihishe, icyitegererezo ntigishobora gukoporora hafi ya pigiseli hafi kandi igomba kwiga imiterere ifatika, nkibishusho nibice byibintu. Kodegisi isimbuka ibipapuro byapanze bituma imyitozo yihuta kandi yibuka neza. Nyuma yo kwitegura, decoder irajugunywa kandi kodegisi yimura cyane imirimo yo gutondeka, gutahura, no gutandukanya.

Ubushishozi

Amayeri yingenzi ni asimmetrie: kodegisi iremereye ibona gusa 25% byapimwe, mugihe decoder ntoya yubaka ibisigaye. Ibishishwa birasibanganye, byashyizwe kumurongo, kandi bihabwa kodegisi ya posisiyo. Igihombo cyo kwiyubaka bivuze ikosa ryakorewe kubarwa gusa kubipfunyitse, mubisanzwe kuri pigiseli isanzwe. Ikigereranyo cyo hejuru cya masking gihatira kwiga semantique aho kuba interpolation yo murwego rwo hasi, no gusimbuka ibimenyetso bya maskike mugukata kodegisi bibara kuburyo butandukanye no gutunganya ishusho yuzuye.

Kumenya Masked Autoencoders

Masked Autoencoders (MAE) nuburyo bwigenga bwigisha moderi yicyerekezo cyo kongera kubaka amashusho nyuma yifoto myinshi ihishe. Nukwiga kuzuza ibibuze, icyitegererezo cyubaka imyumvire ikungahaye idafite ikirango cyabantu. Masked Autoencoders ni iyimikorere ya mudasobwa-iyerekwa isobanura cyangwa itanga itangazamakuru ryerekanwa ryo gusesengura, ibikorwa, no guhanga. Kugirango wubake byimbitse, fata Masked Autoencoders nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha Masked Autoencoders aringaniza neza nukuri kubikorwa nkubwiza bwamakuru, itandukaniro ryamatara, hamwe na labels bihoraho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza ka Masked Autoencoders

MAE-yuburyo bwa maskike yo kwiyubaka irahinduka uburyo bwo kwitegura mbere yuburyo butandukanye. Abashakashatsi barayigeza kuri videwo (guhisha umwanya wa cubes), amajwi yerekana amajwi, gusikana kwa muganga, hamwe n'amashusho ya satelite, aho ibirango ari bike kandi bihenze. Witegereze guhuza imvugo nururimi rwimikorere ya modimodal moderi, decoders ikora neza, hamwe na maskike yo guhuza n'imiterere yibasira uturere twamakuru. Mugihe compte ikura, kwipfukirana ibipapuro byerekana amashusho manini atashyizweho ikimenyetso bigomba gukomeza kunoza neza neza mugihe bigabanya gushingira kumatangazo ahenze yabantu.

Gushyira mu bikorwa Isi

Gutegura Vision Transformer kuri miriyoni y'amafoto atanditseho, hanyuma ukayitunganya neza kugirango ushireho ImageNet hamwe nukuri neza

Ibiranga imyigire ya scan yubuvuzi itemewe (X-imirasire, MRIs) aho ibisobanuro byinzobere bihenze kandi bigarukira

Guhuza uburyo na videwo muguhisha umwanya wigihe cyo kwerekana ibikorwa-kumenyekanisha ibikorwa (VideoMAE)

Kwitegura kuri satelite n'amashusho yo mu kirere kugirango ushyigikire ikarita ikoreshwa-ikarita kandi uhindure gutahura nta kirango cy'intoki

Uburyo bwo Gushyira mu bikorwa

Masked Autoencoders mubikorwa

Gutegura icyerekezo cya Vision kuri miriyoni y'amafoto atanditseho, hanyuma ukayitunganya neza kugirango ushireho ImageNet hamwe nukuri.

Gutegura Vision Transformer kuri miriyoni zamafoto atanditseho ikimenyetso, hanyuma ukayitondekanya neza kugirango ushireho amashusho ya ImageNet hamwe nukuri gukomeye Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Masked Autoencoders mubikorwa

Ibiranga imyigire ya scan yubuvuzi itemewe (X-imirasire, MRIs) aho ibisobanuro byinzobere bihenze kandi bigarukira.

Ibiranga imyigire uhereye kuri scan yubuvuzi itemewe (X-imirasire, MRIs) aho ibisobanuro byinzobere bihenze kandi Amakipe make asanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Masked Autoencoders mubikorwa

Guhuza uburyo bwo gukora amashusho muguhisha umwanya wigihe cyo kwerekana ibikorwa-kumenyekanisha ibikorwa (VideoMAE).

Guhuza uburyo bwo gufata amashusho ukoresheje masike yigihe cyagenwe kugirango ugaragaze ibikorwa-byo kumenyekanisha ibikorwa (VideoMAE) Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Masked Autoencoders mubikorwa

Kwitegura kuri satelite n'amashusho yo mu kirere kugirango ushyigikire ikarita ikoreshwa-ikarita kandi uhindure gutahura nta kirango cy'intoki.

Gutegura kuri satelite n'amashusho yo mu kirere kugirango ushyigikire ikarita yo gukoresha ubutaka no guhindura ibimenyetso bidafite ibimenyetso byintoki Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

!

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

!

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi