Bottleneck Ubwubatsi
Ubwubatsi bubi busunika amakuru binyuze murwego ruto rwagati mbere yo kongera kwagura, guhatira umuyoboro kwiga guhuza, gukora neza.
Incamake
It is a core trick for building very deep, fast models without exploding compute.
Kwibira cyane
Bottleneck ishushanya amakuru nkana inzira binyuze murwego rwo hasi 'pinch point.' Muri ResNet, guhagarika icyuho bifashisha 1x1 kugirango ugabanye imiyoboro (vuga 256 kugeza 64), imyanzuro ya 3x3 ikora imirimo iremereye cyane ihendutse kumiyoboro yagabanijwe, nubundi 1x1 yemeza kugarura umubare wumuyoboro. Iyi sandwich igabanya kugwiza-kongerera igiciro cya 3x3 ihenze, kureka imiyoboro igera kuri 50, 101, cyangwa 152 ku buryo buhendutse. Ihame rimwe naryo riha imbaraga autoencoders, aho kodegisi yihishe ihatira kwikuramo, hamwe nuduce duto twa MobileNetV2, aho umuyoboro waguka noneho ugasezerana. Igitekerezo gihuza: kugabanya ibipimo ahantu hatoranijwe bitanga umusaruro, guhora, hamwe nibishobora gukoreshwa.
Ubushishozi
Kuzigama biva mugukora ibikorwa bihenze mubutaka bwagabanijwe. Imodoka ya 3x3 irenga 256 igura ~ 9x256x256 kugwiza-kongeraho kumwanya uri; kugabanuka kumiyoboro 64 ubanza gukata ibyo kuri ~ 9x64x64, hamwe na 1x1 bihendutse bikora projection. Muri autoencoders, ubunini bwa buke bugena umubare winjiza ugomba guhagarikwa, bikora nkigisenge cyamakuru decoder igomba kwiyubaka.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'ubwubatsi bwa Bottleneck
Ibitekerezo bya Bottleneck birahari hose muri AI ikora neza. Ibisigisigi byahinduwe bisigaye byiganjemo iyerekwa rya mobile, inzitizi zo mu rwego rwo hasi zishimangira imiterere ya LoRA ihuza neza imvugo nini yindimi nini zihendutse, hamwe nibitekerezo (nkibisobanuro byihishe bya Perceiver) byigiciro cya quadratic. Tegereza gukomeza gukoreshwa uko moderi ikura: inzira ihendutse yo kongerera ubushobozi ni kwaguka muri make no guhina ahandi, kandi uburyo bukoresha ibipimo bizakomeza gukoresha amanota yo hasi.
Gushyira mu bikorwa Isi
ResNet-50/101/152 koresha 1x1-3x3-1x1 guhagarika icyuho kugirango uhugure ibice amajana neza muburyo bwo gutondekanya amashusho.
MobileNetV2 ihindagurika yibisigisigi bisigara ituma iyerekwa ryigihe kuri terefone hamwe na chip yashyizwemo.
Autoencoders hamwe na autoencoders zitandukanye zikoresha icyuho cyihishe cyihishwa kugirango ugabanye amashusho yo kwerekana no gutahura anomaly.
LoRA itunganya neza yinjiza icyuho cyo hasi murwego rwindimi nini kugirango zishobore guhuzwa nigice gito cyibipimo byitozwa.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Bottleneck Architectures quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ubwubatsi bwa AI
Ibibazo bikunze kubazwa
What is Bottleneck Architectures?
Ubwubatsi bubi busunika amakuru binyuze murwego ruto rwagati mbere yo kongera kwagura, guhatira umuyoboro kwiga guhuza, gukora neza. Nuburyo bwibanze bwo kubaka moderi yimbitse cyane, yihuta idaturika compte.
Mubice bya ResNet, ni uruhe ruhare rwambere rwa 1x1?
Imiyoboro ya 1x1 iyoboye igabanya umuyoboro kubara bityo igiciro cya 3x3 ihenze ikorera mumwanya muto uhendutse, wagabanijwe.
Ni ukubera iki icyuho gituma imiyoboro yimbitse ihendutse kubara?
Mugabanye ibipimo byambere, uburemere buremereye bwa 3x3 bukora kumiyoboro mike cyane, kugabanya kugwiza-kongera igiciro.
MobileNetV2 ikoresha niyihe variant yigitekerezo cyacitse?
MobileNetV2 yagura imiyoboro hamwe na 1x1 conv, ikora akazi kimbitse cyane, hanyuma igasezerana, icyuho gisigaye.
Nigute LoRA ikoresha amahame agenga imiterere yindimi nini?
LoRA yerekana ivugurura ryibiro nkibicuruzwa bibiri bito bito byo mu rwego rwo hasi, icyuho kigabanya cyane ibipimo byatozwa.
Inzira isanzwe ya ResNet ihagarikwa ikurikira niyihe nzira?
Igabanya imiyoboro hamwe na 1x1, itunganya hamwe na 3x3, hanyuma igarura imiyoboro hamwe nindi 1x1.