CLIP na Icyerekezo-Ururimi Icyitegererezo
CLIP nicyitegererezo kuva OpenAI yiga guhuza amashusho ninyandiko ushyira byombi mumwanya umwe.
Incamake
It is the quiet workhorse behind image search, content moderation, and many text-to-image generators.
Kwibira cyane
Yasohowe mu 2021, CLIP (Itandukaniro Ryururimi-Ishusho Yambere-Amahugurwa) yatojwe kuri miriyoni 400 zamafoto-yerekana amashusho yakuwe kurubuga. Ikoresha kodegisi ebyiri: imwe ihindura ishusho mo vector, indi ihindura inyandiko muri vector, kandi byombi bigwa mumwanya uhuriweho. Umunyamideli ariga kuburyo ifoto yimbwa namagambo "ifoto yimbwa" bicara hamwe, mugihe bombi badahuye bicara kure. Ibi bifungura ibyiciro bya zeru: kuranga ishusho, urabigereranya nibisobanuro byanditse mubyiciro byabakandida hanyuma ugahitamo hafi, utabanje guhugura ibyiciro byabigenewe. CLIP yabaye ibikorwa remezo shingiro, iyobora imashini itanga amashusho, iha imbaraga amashusho yishakisha, gushungura imibare, no gutera imbuto nini nini yerekana ururimi rwicyerekezo nka Flamingo, LLaVA, na GPT-4V.
Ubushishozi
CLIP yatojwe ifite intego itandukanye. Mu cyiciro cyibishusho-byanditse byombi, ibara ibisa (binyuze muri cosine isa) hagati ya buri shusho na buri cyapa, hanyuma igahindura kodegisi kugirango igabanye amanota kuri joriji ikwiye kandi igabanye amanota kubintu byose bitari byo. Ishusho ya kodegisi ni muburyo bwa Vision Transformer igabanya ishusho mubice; inyandiko encoder ni Transformer hejuru yikimenyetso. Kuberako byombi bitanga ibice bigereranywa, urashobora guhuza ishusho iyariyo yose ninyandiko.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka CLIP hamwe nicyerekezo-Ururimi rwicyitegererezo
Guhuza uburyo bwa CLIP ubu ni inyubako yubaka imbere muri moderi nini ya multimodal ishobora no kuganira, gutekereza, no gusubiza ibibazo bijyanye namashusho. Tegereza amahugurwa manini kandi asukuye, gushyigikira indimi nyinshi, no kwagura amashusho n'amajwi. Abashakashatsi barimo gukora kugirango bagabanye kubogama kwabaturage n’imibereho ya CLIP yakuwe mu makuru y’urubuga, no kunoza imyumvire yuzuye (kubara ibintu, gusoma inyandiko, imibanire y’ahantu) aho imiterere itandukanye ikomeza kuba intege nke. Nka verisiyo ifunguye nka OpenCLIP ikuze, iyi shusho-inyandiko ya kole izakomeza gukwirakwira mubushakashatsi, robotike, nibikoresho byifashishwa.
Gushyira mu bikorwa Isi
Gushakisha isomero ryamafoto hamwe ninteruro karemano nka "izuba rirenze hejuru yimisozi" aho kuranga izina rya fayili
Kuyobora inyandiko-ku-shusho ya generator kugirango ibisubizo bihuze nibisabwa
Kumurika amashusho adafite umutekano cyangwa hanze ya politiki uyagereranya nibisobanuro byanditse kubintu bibujijwe
Gutunganya-kwikora cyangwa kwandika ibisobanuro binini byerekana ishusho yamakuru yubushakashatsi cyangwa e-ubucuruzi
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the CLIP and Vision-Language Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Icyerekezo-Ururimi-Igikorwa Cyitegererezo cya Robo
Ibibazo bikunze kubazwa
What is CLIP and Vision-Language Models?
CLIP nicyitegererezo kuva OpenAI yiga guhuza amashusho ninyandiko ushyira byombi mumwanya umwe. Nibikorwa byicecekeye byakazi inyuma yishakisha ryamashusho, kugereranya ibintu, hamwe ninyandiko nyinshi-z-amashusho.
Niki gitekerezo cyibanze inyuma ya CLIP?
KANDA ikarita yerekana amashusho hamwe ninyandiko mumwanya umwe uhuriweho na vector kugirango ibisa nabyo birashobora gupimwa muburyo butaziguye.
Ni ubuhe buryo bwo guhugura CLIP ikoresha?
CLIP ikoresha intego itandukanye: gukosora ishusho-ibisobanuro byombi bikururwa hafi mugihe bibiri bidahuye bisunikwa bitandukanye.
Bisobanura iki 'gushyiramo zeru-kurasa' hamwe na CLIP bisobanura?
CLIP irashobora kuranga amashusho ntabwo yigeze itozwa muburyo bwo kuyashyira mugereranya nibisobanuro byanditse mubyiciro byabakandida.
Nigute CLIP ipima niba ishusho nibisobanuro bihuye?
CLIP ifunga buri kimwe muri vector kandi ikabara cosine isa; byinshi bisa bisobanura guhuza hafi ya semantique.
Hafi yamakuru angahe CLIP yatojwe?
CLIP yigiye kuri miriyoni 400 z'amashusho-yerekana amashusho yakusanyirijwe kuri interineti, itanga ubumenyi bwagutse-ururimi.