CLIP da Samfuran Harshen Hangen nesa
CLIP samfuri ne daga OpenAI wanda ke koyon haɗa hotuna da rubutu ta hanyar sanya duka a sararin lissafi iri ɗaya.
Dubawa
It is the quiet workhorse behind image search, content moderation, and many text-to-image generators.
Zurfafa nutsewa
An sake shi a cikin 2021, CLIP (Tsarin Horowar Hoto na Harshe) akan kusan nau'ikan taken hoto miliyan 400 da aka goge daga gidan yanar gizo. Yana amfani da encoders guda biyu: ɗayan yana juya hoto zuwa vector, ɗayan yana juya rubutu zuwa vector, kuma duka biyu suna ƙasa a cikin sararin haɗin gwiwa. Samfurin ya koyi yadda hoton kare da kalmomin "hoton kare" za su zauna kusa da juna, yayin da ma'auratan da ba su dace ba suna zaune a nesa. Wannan yana buɗe rarrabuwar sifili: don yiwa hoto lakabi, kuna kwatanta shi da kwatancen rubutu na nau'ikan ƴan takara kuma ku zaɓi mafi kusa, ba tare da horar da ƙwararrun ƙira ba. CLIP ya zama tushen ababen more rayuwa, jagorar janareta na hoto, ƙarfafa binciken hoto na ma'ana, tace bayanai, da shuka manyan nau'ikan yaren hangen nesa na yau kamar Flamingo, LLaVA, da GPT-4V.
Fahimtar Fasaha
An horar da CLIP tare da maƙasudin maƙasudi. A cikin nau'i-nau'i-nau'i-nau'i-nau'i na hoto, yana ƙididdige kamanceceniya (ta hanyar kamannin cosine) tsakanin kowane hoto da kowane taken, sa'an nan kuma ya daidaita maƙallan don ƙara yawan maki don madaidaitan nau'i-nau'i da rage maki ga duk haɗuwa mara kyau. Rubutun hoton yawanci shine Mai Canjawa hangen nesa wanda ke raba hoto zuwa faci; Rubutun rubutun shine Mai Canjawa akan Alamu. Domin duka biyun suna samar da nau'ikan nau'ikan nau'ikan iri, zaku iya daidaita kowane hoto da kowane rubutu akan tashi.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar CLIP da Samfuran Harshen Hangen nesa
Daidaita salon CLIP yanzu tubalin gini ne a cikin manyan nau'ikan nau'ikan abubuwa masu yawa waɗanda kuma zasu iya yin taɗi, tunani, da amsa tambayoyi game da hotuna. Yi tsammanin mafi girma da tsaftataccen tsarin horo, tallafi ga yaruka da yawa, da haɓaka zuwa bidiyo da sauti. Masu bincike suna aiki don rage ra'ayi na zamantakewa da al'umma CLIP da aka sha daga bayanan yanar gizo, da kuma inganta fahimta mai kyau (ƙidaya abubuwa, karatun rubutu, dangantakar sararin samaniya) inda samfurori masu bambanci suka kasance masu rauni. Kamar yadda buɗaɗɗen nau'ikan kamar OpenCLIP suka girma, wannan manne-rubutun hoto zai ci gaba da yaɗuwa cikin bincike, injiniyoyi, da kayan aikin samun dama.
Aiwatar da Gaskiyar Duniya
Neman ɗakin karatu na hoto tare da jumlar dabi'a kamar "faɗuwar rana bisa tsaunuka" maimakon alamun sunan fayil
Jagoran janareta na rubutu-zuwa-hoto don haka abubuwan da aka fitar sun dace da abin da aka nema
Sanya hotuna marasa aminci ko marasa tsari ta hanyar kwatanta su da kwatancen rubutu na abubuwan da aka haramta
Tsara kai tsaye ko taken manyan bayanan hoto marasa lakabi don bincike ko kasuwancin e-commerce
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the CLIP and Vision-Language Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Hanyoyi-Harshen-Ayyukan Ayyuka don Robotics
Tambayoyin da ake yawan yi
What is CLIP and Vision-Language Models?
CLIP samfuri ne daga OpenAI wanda ke koyon haɗa hotuna da rubutu ta hanyar sanya duka a sararin lissafi iri ɗaya. Dokin aikin shiru ne a bayan binciken hoto, daidaita abun ciki, da yawancin janareta na rubutu zuwa hoto.
Menene ainihin ra'ayin bayan CLIP?
Taswirorin CLIP duka hotuna da rubutu zuwa sararin sarari guda ɗaya don a iya auna kamanninsu kai tsaye.
Wane tsarin horo ne CLIP ke amfani da shi?
CLIP yana amfani da maƙasudin maƙasudi: madaidaicin nau'i-nau'i-nau'i-nau'i-nau'i an jawo su kusa yayin da waɗanda basu dace ba ana ture su.
Menene ma'anar 'rarrabuwar sifili' tare da CLIP?
CLIP na iya yiwa hotuna lakabin da ba a taɓa horar da shi musamman don rarraba ta hanyar kwatanta su da kwatancen rubutu na nau'ikan ɗan takara ba.
Ta yaya CLIP ke auna ko hoto da taken magana sun yi daidai?
CLIP yana ɓoye kowane cikin vector kuma yana ƙididdige kamancen cosine; kamanceceniya mafi girma yana nufin madaidaicin ma'anar tatsuniyoyi.
Kusan nawa ne aka horar da CLIP akan bayanai?
CLIP ta koya daga kusan nau'i-nau'i-nau'i-nau'i-nau'i-nau'i miliyan 400 da aka tattara daga intanit, suna ba shi ilimin harshe mai faɗi.