Kapsioŋu nataal
Liggéeyu sotti nataal mooy defar ci saasi ab frase ci làkk wiñ nàmp ngir fësal li ci biir nataal bi.
Résumé
It bridges vision and language, turning pixels into words that explain content, objects, and actions.
Plongeur bu xóot
Sistemu bindu nataal yi dañuy jël benn nataal ba noppi joxe ay leeral yu leer lu mel ni 'xaj bu maron buy jàpp frisbee ci kaw ñax.' Sistem yu njëkk ya dañu boole reso convolutionnel buy génne màndarga yi ñuy gis ak reso buy baaxoo (LSTM) buy defar baat benn-benn, ñu koy faral di teg ci bàyyi xel, suko defee model bi 'xool' gox yi war ci baat bu nekk. Sistem yu bees yi dañuy jëfandikoo enkodeer transformatër ngir gis-gis ak dekodeer transformatër ngir làkk, ba noppi modeli làkk yu mag yu melni BLIP-2 ak GPT-4V mën nañu bind nataal yi ci anam wu neex. Taggat dafay aju ci ay done yu melni MS COCO, fu nataal bu nekk am ay mbind yu bari yu nit bind. Kalite dañu koy natt ci ay metric yu melni CIDEr, BLEU, ak CLIPScore bi lalu ci samp gi.
Gis-gis xarala
Kapsioner yu bari dañu topp motif encodeur-decodeur. Encoder bi dafay soppi nataal bi def ko ay vecteur yu am màndarga; dekodeer bi dafay defar ay baat ci anam wu autoregressif, di wax luy waaja am ci token bu nekk ci nataal bi ak baat yiñ njëkka defar. Foofu dafay tax dekodeer bi diisaay ci gox yu wuute ci nataal ci baat bu nekk, gëna suqali grounding bi. Taggat yaram dafay jëfandikoo cross-entropy ci kaw dëgg-kapsiyon, yenn saa mu topp ci jàng-jàng buy gëna dooleel metric kalite caption bu melni CIDEr directement ngir wàññi exposition biais.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Kaption Nataal
Captioning mooy boole ay misaali làkku gis-gis bu ëpp solo, te duñu yam ci joxe leeral waaye tontu laaj yi, xalaat ak topp tegtal yi jëm ci nataal yi. Xaarandil ay mbind yu gëna dëgër, gëna yomba saytu (guddaay buñ mëna regle, stil, wala focus), grounding bu gëna baax ngir dakkal mbir yu baaxul yi, ak jumtukaayi accessibilité yu gëna am doole yuy nettali àdduna bi ñuy gis ci jamono dëgg. Ay lakk yu bari ak wideo dinañu gëna yaatu, ay model ci aparey yi dinañu inndi ay leeral yu nëbbu ci saasi ci telefon yi ak wearables ngir jëfandikukat yu silmaxa yi ak yu dul gis bu baax.
Doxal ci àdduna dëgg
Defar ay tegtali alt-text ci nataal yi suko defee ñiy jàng ekraŋ yi mëna jàppale jëfandikukat yu silmaxa yi ak yu dul gis bu baax
Digle ci saasi ay mbind ak etiket yuñ mëna seetee ngir bibliotek foto yu mag ak platform nataali stock
Tegtal li ko wër ak kàddu yu kawe jaaraleko ci aplikaasioŋ yu melni Microsoft Gis IA wala Nekk samay bët
Indexage kadre wideo ak ay leeral ci mbind ngir mëna seetlu ëmbiit li ak yamale ci escalier
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Image Captioning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Modèlu nataalu FLUX
Laaj yi ñuy faral di laaj
What is Image Captioning?
Liggéeyu sotti nataal mooy defar ci saasi ab frase ci làkk wiñ nàmp ngir fësal li ci biir nataal bi. Dafay boole gis-gis bi ak làkk wi, di soppi pixel yi ñu nekk kàddu yuy leeral ëmbiit li, mbir yi ak jëf yi.
Lan la sistemu sous-titre nataal di defar ci génne gi?
Kapsioŋu nataal dafay defar ab mbind buy fësal li ci biir nataal bi.
Ci biir pipeline biy bind sottite, ban cër la encodeur visuel bi di def?
Encodeur bi (dafay faral di nekk CNN wala transformateur vision) dafay soppi nataal bi ci vecteur yu am màndarga yi decodeur làkk bi di jëfandikoo.
Lan moo waral bàyyi xel ci nataal yi am njariñ?
Foofu dafay jàppale dekodeer bi mu 'xool' wàll yi gëna am solo ci nataal bi sooy defar baat bu nekk, gëna baaxal grounding bi.
Ban setu done lañu gëna jëfandikoo ngir tàggat ak jàngat mbindu nataal yi?
MS COCO dafay joxe nataal bu nekk ak ay mbind yu bari yu nit ñi bind, moo tax mu nekk xeetu mbind buñ miin.
Lan mooy tekki dekodeeru kapsiyoŋ ngir defar ay baat 'ci anam wu dellu ginaaw'?
Generation autorégressive dafay defar ay token benn-benn, bu nekk ci ñoom mingi aju ci ay token yu njëkk ya ak nataal bi.