Nhungamiro yehunyanzvi

Kuongorora AI Vhidhiyo Majenareta neVBench

VBench ndeye benchmark suite yezvinyorwa-kune-vhidhiyo modhi.

Teerera kugwaro iriAI-yakarondedzerwa · ~3 min

Pa peji ino3 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reKuongorora AI Vhidhiyo Majenareta ane VBench
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Inopatsanura mhando yevhidhiyo kuita 16 mativi akapatsanurwa, akadai sekuenderana kwechinyorwa, kufamba kwakatsetseka, ine simba dhigirii uye aesthetic mhando, uye inoverengera imwe neimwe ine yakazvitsaurira otomatiki evaluator. Izvi zvine basa nekuti nhamba imwe chete haigone kuratidza kana vhidhiyo yakapinza, yakatsetseka, yakatendeka kune yayo nekukurumidza uye inofamba chaizvo, uye VBench inoita kuti izvo zvekutengesa zvionekwe.

Kudzika Kwakadzika

VBench yakaunzwa mukupera kwa2023 nevaongorori kubva kuNanyang Technological University's S-Lab uye Shanghai AI Laboratory, uye yakaunzwa paCVPR 2024. Pfungwa yayo huru ndeyekuora. Panzvimbo pechibodzwa chimwe chakadai seFVD (Frechet Vhidhiyo Distance), inoyera mativi gumi nematanhatu akaiswa mumhuri mbiri. Vhidhiyo mhando zviyero zvinotonga iyo clip pachayo, zvisinei nekukasira: kuenderana kwechinyorwa, kuenderana kwemashure, kupenya kwechinguvana, kutsvedzerera kwekufamba, dhigirii ine simba, aesthetic mhando uye yekufungidzira mhando. Vhidhiyo-mamiriro ekuenderana zviyero zvinotonga kuti vhidhiyo yacho inonyatsotevera sei kukurumidza kwayo: kirasi yechinhu, zvinhu zvakawanda, chiito chemunhu, ruvara, hukama hwepakati, chiitiko, chimiro chechimiro, chimiro chenguva uye kuenderana kwese. Dimensioni yega yega ine sutu yekukasira uye muongorori ane hunyanzvi, kazhinji muenzaniso uripo wechiratidzo. Kusaenderana kwechidzidzo kunofananidza maDINO maficha pamafuremu. Background kuenderana kunoshandisa CLIP maficha. Dynamic degree inoshandisa optical flow. Aesthetic uye yekufungidzira mhando shandisa yakadzidza yemhando yekufembera, uye chinhu uye cheki chemavara shandisa kuona kana mamodheru. Vanyori vakaunganidza zvirevo zvekufarira kwevanhu pachiyero chega chega uye vakataura kuti zvibodzwa zve otomatiki zvinowirirana nazvo. Kuparara kwacho kunofumura kutengeserana kunovanza zvachose. Vhidhiyo inenge yakaomeswa nechando inogona kuhwina zvakanyanya pakuenderana uye kutsvedzerera uku ichirova zvisina kunaka padhigirii rine simba, saka kuverenga chete avhareji kunogona kupa mibairo yeanotya. Huwandu hweVBench hausi huwandu hwakazara hwemamodhi evhidhiyo; inoratidza zvirevo zvakasarudzwa, vaongorori uye uremu. Gare gare basa rakawedzera suite. VBench ++ yakawedzera mufananidzo-kune-vhidhiyo uye kuvimbika kuongororwa, uye VBench-2.0 inotarisa zvakadzika zvivakwa zvakaita sefizikisi, commonsense uye anatomy yemunhu. Nhandare dzeveruzhinji, uko vanhu vanovhota pakati pezvikamu zviviri zvisingazivikanwe kubva panguva imwecheteyo, zvinotora zvaunofarira, kusanganisira hunhu hwakadai sekufamba kunonzwisisika uko vaongorori vega havasati vayera nekuvimbika.

Kuitwa muNyika yeChokwadi

Lab inoburitsa yakavhurika vhidhiyo modhi inoshuma iyo VBench yakazara uye iyo per-dimension kuputsika. Iko kuparara kunoratidza kuti inotungamira pamhando yekufungidzira asi inofamba pane ine simba degree.

Mugadziri anofananidza maviri masampler marongero uye anoona kuti kushandisa nhanho shoma kunodzikisa kutsvedzerera kwekufamba uye zvibodzwa zvenguva pfupi. Izvo zvinotungamira sarudzo yavo pakati pekumhanya nemhando.

Chigadzirwa chechikwata chinopfupisa vhidhiyo APIs inosanganisa nhamba dzeVBench nemhedzisiro kubva munhandare yevhoti yevanhu, nekuti vashandisi vavo vanonyanya kufarira nezvechokwadi fizikisi nevanhu.

Mutsvaguri anoona modhi ichikwira zvakanyanya pachidzidzo uye kuenderana kwemashure uku ichigadzira anenge akatsiga zvimedu. Ivo vanotarisa iyo dynamic degree dimension kuti vazvisimbise.

Ramangwana reKuongorora AI Vhidhiyo Majenareta ane VBench

Ongororo yevhidhiyo iri kusimuka kubva pamhando yepamusoro kuenda kune kana nyika dzakagadzirwa dzinoita zvinonzwisisika: zvinhu zvinogara zvakasimba, simba rinokwevera zvinhu pasi rinoshanda uye maoko anochengeta nhamba chaiyo yeminwe. Mabhenji akadai seVBench-2.0 uye physics-yakatarisana bvunzo seti inovavarira pane izvi, kazhinji ine multimodal mutauro modhi sevatongi, izvo zvinomutsa mibvunzo mitsva nezvekuti vanovimbika sei vatongi ivavo. Zvikamu zvirefu, odhiyo uye kamera yekudzora inodawo ma metrics ayo ezvino masutu anongovhara chikamu. Nhandare dzevanhu dzinogona kuramba dzakakosha nekuti dzinotora zvadzinoda, asi dzinodhura, dzinonzwa kuratidzwa uye dzakaoma kuburitsa, saka munda ungangoramba uchishandisa nzira dzese.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Evaluating AI Video Generators with VBench quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Kuongorora AI Vhidhiyo Majenareta ane VBench?

VBench ndeye benchmark suite yezvinyorwa-kune-vhidhiyo modhi. Inopatsanura mhando yevhidhiyo kuita 16 mativi akapatsanurwa, akadai sekuenderana kwechinyorwa, kufamba kwakatsetseka, ine simba dhigirii uye aesthetic mhando, uye inoverengera imwe neimwe ine yakazvitsaurira otomatiki evaluator. Izvi zvine basa nekuti nhamba imwe chete haigone kuratidza kana vhidhiyo yakapinza, yakatsetseka, yakatendeka kune yayo nekukurumidza uye inofamba chaizvo, uye VBench inoita kuti izvo zvekutengesa zvionekwe.

Ingani zviyero zvekuongorora zvinotsanangurwa neVBench yekutanga?

VBench inotsemura mhando yekugadzirwa kwevhidhiyo muzvikamu gumi nematanhatu, zvakaiswa mumhando yevhidhiyo uye kuenderana kwevhidhiyo.

Ndeupi chiyero chaizoratidza kuti modhi inogadzira anenge akamira mavhidhiyo?

Dhigirii reDynamic rinoshandisa kuyerera kwemaziso kuyera kuti inofamba sei vhidhiyo. Klipu yakaomeswa ine zvibodzwa zvakaderera pano kunyangwe iine zvibodzwa zvakakwirira pakuenderana.

Chii chinoshandiswa neVBench kuyera kuenderana kwechinyorwa pamafuremu?

Kusaenderana kwechidzidzo kunoenzanisa maDINO maficha echinyorwa pamafuremu kutarisa kuti anoramba akafanana.

Ndedzipi mhuri mbiri dzinobatanidza zviyero zveVBench?

Vhidhiyo mhando zviyero zvinotonga clip zvisinei nekukasira, ukuwo vhidhiyo-condition kusachinja-chinja zviyero zvinotonga kuti vhidhiyo inotevera sei kukurumidza kwayo.

Sei kuverenga chete VBench's zvibodzwa zvese kuchigona kurasisa?

Huwandu hwemaavhareji hunoenderana. Kuenderana kwepamusoro kunogona kuvanza kufamba kwakaderera, saka per-dimension mhedzisiro ine basa.