Uhlolojikelele
Amazwibela esithombe kuwumsebenzi wokukhiqiza ngokuzenzakalelayo umusho wolimi lwemvelo ochaza lokho okusesithombeni. Ihlanganisa umbono nolimi, iguqule amaphikseli abe amagama achaza okuqukethwe, izinto, kanye nezenzo.
Amagama-ncazo esithombe okokugeleza kokusebenza kombono wekhompuyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, nokudala.
I-Deep Dive
Amasistimu wamagama-ncazo wesithombe athatha isithombe futhi akhiphe incazelo eshelelayo njengokuthi 'inja ensundu ebamba inyosi otshanini.' Amasistimu angaphambili amatanise inethiwekhi ye-convolutional ekhiphe izici ezibukwayo ngenethiwekhi eqhubekayo (i-LSM) ekhiqize amagama elilodwa ngesikhathi, ngokuvamile eqondiswa ukunaka ukuze imodeli 'ibuke' izifunda ezifanele zegama ngalinye. Amasistimu esimanje asebenzisa amakhodi e-transformer ukuze abone kanye namadekhoda okuguqula ulimi, futhi amamodeli amakhulu olimi lokubona njenge-BLIP-2 ne-GPT-4V angasho amazwibela ezithombe ngokushelela okuphawulekayo. Ukuqeqeshwa kuncike kumasethi edatha afana ne-MS COCO, lapho isithombe ngasinye sinamagama-ncazo amaningi abhalwe abantu. Ikhwalithi ikalwa ngamamethrikhi afana ne-CIDER, BLEU, kanye ne-CLIPScore esekelwe ekushumekeni.
I-Technical Insight
Iningi lamagama-ncazo lilandela iphethini yesikhiphi khodi. Isifaki khodi siguqula isithombe sibe isethi yama-vector esici; i-decoder ikhiqiza amagama ngokuzenzakalelayo, ibikezela ithokheni ngalinye elibekwe esithombeni kanye namagama akhiwe ngaphambilini. Ukunakwa kuvumela isiqophi sekhodi ukuthi sinde izifunda ezihlukene zesithombe ngegama ngalinye, sithuthukise ukusekela. Ukuqeqeshwa kusebenzisa i-cross-entropy kumagama-ncazo weqiniso eliphansi, ngezinye izikhathi okulandelwa ukufunda okuqiniswayo okuthuthukisa imethrikhi yekhwalithi yamagama-ncazo efana ne-CIDEer ngokuqondile ukuze kwehliswe ukuchema kokuchayeka.
I-Master Captioning Image
Amazwibela esithombe kuwumsebenzi wokukhiqiza ngokuzenzakalelayo umusho wolimi lwemvelo ochaza lokho okusesithombeni. Ihlanganisa umbono nolimi, iguqule amaphikseli abe amagama achaza okuqukethwe, izinto, kanye nezenzo. Amagama-ncazo esithombe okokugeleza kokusebenza kombono wekhompuyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, nokudala. Ukuze wakhe ukuqonda okujulile, phatha Amazwibela Wesithombe njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, cacisa ukuqagela, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi Yegama-ncazo Lesithombe namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukukhiqiza izincazelo zombhalo we-alt wezithombe ukuze izifundi zesikrini zisize abasebenzisi abayizimpumputhe nabangaboni kahle
Amagama-ncazo azenzakalelayo kanye namathegi aseshekayo amalabhulali ezithombe ezinkulu nezinkundla zezithombe zesitoko
Ukuchaza indawo ezungezile ngokuzwakalayo ngezinhlelo zokusebenza ezifana ne-Microsoft Ukubona i-AI noma i-Be My Eyes
Yenza inkomba ozimele bevidiyo abanezincazelo zombhalo ukuze unike amandla ukusesha okuqukethwe kanye nokulinganisa esikalini
Amaphethini Okusebenzisa
Amazwibela esithombe ayasebenza
Ukukhiqiza izincazelo zombhalo we-alt wezithombe ukuze izifundi zesikrini zisize abasebenzisi abayizimpumputhe nabangaboni kahle.
Ukukhiqiza izincazelo zombhalo ohlukile wezithombe ukuze izifundi zesikrini zisize abasebenzisi abayizimpumputhe nabangaboni kahle Amathimba ngokuvamile athola imiphumela engcono uma echaza imikhawulo yekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amazwibela esithombe ayasebenza
Amagama-ncazo azenzakalelayo kanye namathegi aseshekayo amalabhulali ezithombe ezinkulu nezinkundla zezithombe zesitoko.
Amagama-ncazo azenzakalelayo namathegi aseshekayo emitapo yolwazi emikhulu yezithombe nezinkundla zezithombe zesitoko Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amazwibela esithombe ayasebenza
Ichaza indawo ezungezile ngokuzwakalayo ngezinhlelo zokusebenza ezifana ne-Microsoft Ukubona i-AI noma i-Be My Eyes.
Ukuchaza indawo ezungezile ngokuzwakalayo ngezinhlelo zokusebenza ezifana ne-Microsoft Ukubona i-AI noma i-Be My Eyes Teams ngokuvamile ithola imiphumela engcono uma ichaza imingcele yekhwalithi ngaphambili, igcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi ilandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Amazwibela esithombe ayasebenza
Yenza inkomba ozimele bevidiyo abanezincazelo zombhalo ukuze unike amandla ukusesha okuqukethwe kanye nokulinganisa esikalini.
Ukwenza inkomba ozimele bevidiyo abanezincazelo zombhalo ukuze kunikwe amandla ukusesha nokulinganisa okuqukethwe esikalini Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yezimo ezibucayi, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.