Bayanin Hoto
Taken hoto shine aikin samar da jumla ta harshe ta atomatik wanda ke bayyana abin da ke cikin hoto.
Dubawa
It bridges vision and language, turning pixels into words that explain content, objects, and actions.
Zurfafa nutsewa
Tsarin rubutun hoto suna ɗaukar hoto kuma suna fitar da kwatanci mai kyau kamar 'karen launin ruwan kasa yana kama frisbee akan ciyawa.' Tsarin farko sun haɗa hanyar sadarwa mai jujjuyawa wacce ta fitar da fasalulluka na gani tare da cibiyar sadarwa mai maimaitawa (LSTM) wacce ke haifar da kalmomi ɗaya bayan ɗaya, galibi ana kulawa da hankali don haka ƙirar ta 'duba' yankuna masu dacewa ga kowace kalma. Tsarukan zamani suna amfani da na'urori masu canzawa don hangen nesa da na'urori masu canzawa don harshe, kuma manyan nau'ikan yaren hangen nesa kamar BLIP-2 da GPT-4V na iya ɗaukar hotuna tare da iyawa na ban mamaki. Horowa ya dogara da bayanan bayanai kamar MS COCO, inda kowane hoto yana da rubutu da yawa da ɗan adam ya rubuta. Ana auna inganci tare da ma'auni kamar CIDer, BLEU, da na tushen CLIPScore.
Fahimtar Fasaha
Yawancin masu rubutun ra'ayin mazan jiya suna bin tsarin mai rikodin rikodin rikodin. Encoder yana jujjuya hoton zuwa saitin sifofi; mai ƙaddamarwa yana haifar da kalmomi kai tsaye, yana tsinkaya kowace alamar da aka sharadi akan hoton da kalmomin da aka ƙirƙira a baya. Hankali yana bawa mai yankan damar auna nau'ikan hoto daban-daban a kowace kalma, haɓaka ƙasa. Horowa yana amfani da giciye-entropy akan bayanan gaskiya-ƙasa, wani lokaci ana biye da karatun ƙarfafawa wanda ke haɓaka ma'aunin ingancin taken kamar CIDEr kai tsaye don rage nuna son kai.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar Rubutun Hoto
Taken taken yana haɗawa cikin ƙirar harshe na gaba ɗaya waɗanda ba kawai bayyanawa ba amma kuma suna amsa tambayoyi, dalili, da bin umarni game da hotuna. Yi tsammanin ɗimbin yawa, ƙarin taken magana (daidaitacce tsayi, salo, ko mayar da hankali), ingantaccen tushe na gaskiya don hana abubuwan da ba a gani ba, da ƙarin kayan aikin isa ga waɗanda ke ba da labarin duniyar gani a ainihin lokaci. Rubutun harsuna da yawa da bidiyo za su faɗaɗa, kuma samfuran kan na'urori za su kawo bayanan sirri, bayanan kai tsaye ga wayoyi da kayan sawa ga makafi da masu amfani da hangen nesa.
Aiwatar da Gaskiyar Duniya
Ƙirƙirar bayanin alt-rubutu na hotuna don haka masu karanta allo zasu iya taimakawa makafi da masu amfani da ƙarancin gani
Takamaimai masu ba da shawara ta atomatik da alamun bincike don manyan ɗakunan karatu na hoto da dandamalin hoto
Bayyana kewaye da babbar murya ta aikace-aikace kamar Microsoft Ganin AI ko Kasance Idona
Fitar da firam ɗin bidiyo tare da bayanin rubutu don ba da damar bincika abun ciki da daidaitawa a sikeli
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Image Captioning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Samfuran Hoto FLUX
Tambayoyin da ake yawan yi
What is Image Captioning?
Taken hoto shine aikin samar da jumla ta harshe ta atomatik wanda ke bayyana abin da ke cikin hoto. Yana haɗa hangen nesa da harshe, yana juya pixels zuwa kalmomi waɗanda ke bayyana abun ciki, abubuwa, da ayyuka.
Menene tsarin taken hoto ke samarwa azaman fitarwa?
Taken hoto yana haifar da jumlar rubutu da ke kwatanta abubuwan da ke cikin hoto.
A cikin bututun rubutu na yau da kullun, wace rawa mai rikodin gani ke takawa?
Mai rikodin (sau da yawa CNN ko taswirar hangen nesa) yana juya hoton zuwa nau'ikan nau'ikan nau'ikan nau'ikan da mai sarrafa harshe ke amfani da shi.
Me yasa hankali ke da amfani a rubutun hoto?
Hankali yana taimaka wa mai gyara 'duba' mafi dacewa sassan hoton lokacin samar da kowace kalma, inganta ƙasa.
Wane saitin bayanai ne aka fi amfani dashi don horarwa da kimanta rubutun hoto?
MS COCO yana ba da hotuna kowane haɗe tare da rubutun ɗan adam da yawa, yana mai da shi daidaitaccen ma'auni na taken.
Menene ma'anar ma'anar mai lalata taken don samar da kalmomi 'autoregressively'?
Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwararren Ƙwaƙwalwa na Ƙaddamarwa ya yi yana samar da alamu ɗaya bayan ɗaya, kowanne yana da sharadi akan alamun farko da hoto.