Ụdị CLIP na Ọhụụ-Asụsụ
CLIP bụ ihe nlereanya sitere na OpenAI na-amụta ijikọ onyonyo na ederede site na itinye ha abụọ n'otu oghere mgbakọ na mwepụ.
Nchịkọta
It is the quiet workhorse behind image search, content moderation, and many text-to-image generators.
Ime miri emi
Ewepụtara ya na 2021, CLIP (Ọzụzụ Ntugharị Asụsụ-Onyinye) zụrụ azụ na ihe dị ka nde 400 isi ihe osise ewepụrụ na webụ. Ọ na-eji encoders abụọ: otu na-atụgharị onyonyo ka ọ bụrụ vector, nke ọzọ na-atụgharị ederede ka ọ bụrụ vector, na ala abụọ n'ime oghere na-ekekọrịta. Ihe nlereanya a na-amụta ka foto nke nkịta na okwu "foto nke nkịta" nọkọọ ọnụ, ebe abụọ na-ejikọtaghị ọnụ na-anọdụ ala n'ebe dị anya. Nke a na-emepe nhazi ọkwa efu: iji kpọọ onyonyo, ị na-atụnyere ya na nkọwa ederede nke otu ndị ndoro-ndoro anya wee họrọ nke kacha nso, na-enyeghị ọzụzụ nkesa raara onwe ya nye. CLIP ghọrọ akụrụngwa ntọala, na-eduzi ndị na-emepụta ihe onyonyo, na-eme ka nchọta onyonyo ọmụmụ ihe, nzacha datasets, na ịgha mkpụrụ ụdị asụsụ ọhụụ dị ka Flamingo, LLaVA na GPT-4V.
Nghọta nka nka
A zụrụ CLIP n'ebumnobi dị iche. N'ime batch nke ụzọ abụọ ederede onyonyo, ọ na-agbakọ myirịta (site na myirịta cosine) n'etiti onyonyo ọ bụla na nkọwa okwu ọ bụla, wee na-edozi koodu ntinye ka ọ bawanye akara maka ụzọ abụọ ziri ezi wee wedata akara maka njikọta na-ezighi ezi. Ihe ngbanwe onyonyo a na-abụkarị ihe ntụgharị ọhụụ nke na-ekewa foto n'ime patches; ederede ederede bụ ihe ntụgharị n'elu tokens. N'ihi na ha abụọ na-emepụta vectors atụnyere, ị nwere ike dakọtara oyiyi ọ bụla na ederede ọ bụla na ofufe.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke CLIP na Ụdị Asụsụ Ọhụụ
Nhazi ụdị CLIP ugbu a bụ ihe mgbochi ụlọ n'ime ụdị multimodal buru ibu nke nwekwara ike ịkparịta ụka, tụgharịa uche na zaa ajụjụ gbasara onyonyo. Na-atụ anya nhazi ọzụzụ ka ukwuu ma dị ọcha, nkwado maka ọtụtụ asụsụ, yana ịgbatị vidiyo na ọdịyo. Ndị na-eme nchọpụta na-arụ ọrụ iji belata mkparị mmekọrịta ọha na eze na nke igwe mmadụ CLIP na-enweta site na data weebụ, na imeziwanye nghọta dị mma (ịgụ ihe, ịgụ akwụkwọ, mmekọrịta gbasara mbara igwe) ebe ụdị ndị dị iche na-anọgide na-adịghị ike. Ka ụdị mepere emepe dị ka OpenCLIP tozuru oke, gluu-ederede onyonyo a ga-aga n'ihu na-agbasa n'ofe ọchụchọ, robotics na ngwaọrụ nnweta.
Mmejuputa n'ezie n'ụwa
Ịchọ ọba akwụkwọ foto nwere nkebi ahịrịokwu dị ka "ọdịda anyanwụ n'elu ugwu" kama mkpado aha faịlụ
Na-eduzi ndị na-emepụta ihe na-ederede gaa na onyonyo ka mpụta dabara na ngwa ngwa achọrọ
Na-atụpụta onyonyo adịghị mma ma ọ bụ enweghị iwu site n'ịtụle ha megide nkọwa ederede nke ọdịnaya amachibidoro
Ịhazi akpaaka ma ọ bụ ịde aha nnukwu dataset onyonyo enweghị akara maka nyocha ma ọ bụ azụmahịa e-commerce
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the CLIP and Vision-Language Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ọhụụ-Asụsụ-Ụdị omume maka Robotics
Ajụjụ a na-ajụkarị
What is CLIP and Vision-Language Models?
CLIP bụ ihe nlereanya sitere na OpenAI na-amụta ijikọ onyonyo na ederede site na itinye ha abụọ n'otu oghere mgbakọ na mwepụ. Ọ bụ ịnyịnya na-arụ ọrụ dị jụụ n'azụ ọchụchọ onyonyo, imezi ọdịnaya, yana ọtụtụ ndị na-emepụta ederede gaa na onyonyo.
Gịnị bụ isi echiche dị n'azụ CLIP?
Maapụ CLIP ma onyonyo yana ederede n'otu oghere vector nkekọrịta ka enwere ike tụọ myirịta ha ozugbo.
Kedu usoro ọzụzụ CLIP na-eji?
CLIP na-eji ebumnobi dị iche iche: A na-adọta ụzọ abụọ na-ekwu okwu ziri ezi ka a na-akwapụ ụzọ abụọ na-adakọghị ọnụ.
Kedu ihe 'nhazi efu' na CLIP pụtara?
CLIP nwere ike ịkpọ onyonyo a zụrụbeghị ya kpọmkwem ka ha wee were ya tụnyere nkọwa ederede nke otu ndoro-ndoro ochichi.
Kedu ka CLIP si atụ ma onyonyo na isiokwu nkọwa dabara?
CLIP na-etinye koodu nke ọ bụla n'ime vector ma gbakọọ myirịta cosine; myirịta dị elu pụtara egwuregwu semantic nso.
Ihe dị ka ego ole ka a zụrụ CLIP na ya?
CLIP mụtara site n'ihe dị ka nde mmadụ 400 na-esetịpụ isi okwu foto ndị anakọtara na ịntanetị, na-enye ya amamihe asụsụ a na-ahụ anya.