InoteveraGaidhi rinotevera
Evaluating Recommender Systems: NDCG, Hit Rate and More
Tekinoroji
Nhungamiro yehunyanzvi
VBench ndeye benchmark suite yezvinyorwa-kune-vhidhiyo modhi.
Teerera kugwaro iriAI-yakarondedzerwa · ~3 min
Inopatsanura mhando yevhidhiyo kuita 16 mativi akapatsanurwa, akadai sekuenderana kwechinyorwa, kufamba kwakatsetseka, ine simba dhigirii uye aesthetic mhando, uye inoverengera imwe neimwe ine yakazvitsaurira otomatiki evaluator. Izvi zvine basa nekuti nhamba imwe chete haigone kuratidza kana vhidhiyo yakapinza, yakatsetseka, yakatendeka kune yayo nekukurumidza uye inofamba chaizvo, uye VBench inoita kuti izvo zvekutengesa zvionekwe.
VBench yakaunzwa mukupera kwa2023 nevaongorori kubva kuNanyang Technological University's S-Lab uye Shanghai AI Laboratory, uye yakaunzwa paCVPR 2024. Pfungwa yayo huru ndeyekuora. Panzvimbo pechibodzwa chimwe chakadai seFVD (Frechet Vhidhiyo Distance), inoyera mativi gumi nematanhatu akaiswa mumhuri mbiri. Vhidhiyo mhando zviyero zvinotonga iyo clip pachayo, zvisinei nekukasira: kuenderana kwechinyorwa, kuenderana kwemashure, kupenya kwechinguvana, kutsvedzerera kwekufamba, dhigirii ine simba, aesthetic mhando uye yekufungidzira mhando. Vhidhiyo-mamiriro ekuenderana zviyero zvinotonga kuti vhidhiyo yacho inonyatsotevera sei kukurumidza kwayo: kirasi yechinhu, zvinhu zvakawanda, chiito chemunhu, ruvara, hukama hwepakati, chiitiko, chimiro chechimiro, chimiro chenguva uye kuenderana kwese. Dimensioni yega yega ine sutu yekukasira uye muongorori ane hunyanzvi, kazhinji muenzaniso uripo wechiratidzo. Kusaenderana kwechidzidzo kunofananidza maDINO maficha pamafuremu. Background kuenderana kunoshandisa CLIP maficha. Dynamic degree inoshandisa optical flow. Aesthetic uye yekufungidzira mhando shandisa yakadzidza yemhando yekufembera, uye chinhu uye cheki chemavara shandisa kuona kana mamodheru. Vanyori vakaunganidza zvirevo zvekufarira kwevanhu pachiyero chega chega uye vakataura kuti zvibodzwa zve otomatiki zvinowirirana nazvo. Kuparara kwacho kunofumura kutengeserana kunovanza zvachose. Vhidhiyo inenge yakaomeswa nechando inogona kuhwina zvakanyanya pakuenderana uye kutsvedzerera uku ichirova zvisina kunaka padhigirii rine simba, saka kuverenga chete avhareji kunogona kupa mibairo yeanotya. Huwandu hweVBench hausi huwandu hwakazara hwemamodhi evhidhiyo; inoratidza zvirevo zvakasarudzwa, vaongorori uye uremu. Gare gare basa rakawedzera suite. VBench ++ yakawedzera mufananidzo-kune-vhidhiyo uye kuvimbika kuongororwa, uye VBench-2.0 inotarisa zvakadzika zvivakwa zvakaita sefizikisi, commonsense uye anatomy yemunhu. Nhandare dzeveruzhinji, uko vanhu vanovhota pakati pezvikamu zviviri zvisingazivikanwe kubva panguva imwecheteyo, zvinotora zvaunofarira, kusanganisira hunhu hwakadai sekufamba kunonzwisisika uko vaongorori vega havasati vayera nekuvimbika.
Lab inoburitsa yakavhurika vhidhiyo modhi inoshuma iyo VBench yakazara uye iyo per-dimension kuputsika. Iko kuparara kunoratidza kuti inotungamira pamhando yekufungidzira asi inofamba pane ine simba degree.
Mugadziri anofananidza maviri masampler marongero uye anoona kuti kushandisa nhanho shoma kunodzikisa kutsvedzerera kwekufamba uye zvibodzwa zvenguva pfupi. Izvo zvinotungamira sarudzo yavo pakati pekumhanya nemhando.
Chigadzirwa chechikwata chinopfupisa vhidhiyo APIs inosanganisa nhamba dzeVBench nemhedzisiro kubva munhandare yevhoti yevanhu, nekuti vashandisi vavo vanonyanya kufarira nezvechokwadi fizikisi nevanhu.
Mutsvaguri anoona modhi ichikwira zvakanyanya pachidzidzo uye kuenderana kwemashure uku ichigadzira anenge akatsiga zvimedu. Ivo vanotarisa iyo dynamic degree dimension kuti vazvisimbise.
Ongororo yevhidhiyo iri kusimuka kubva pamhando yepamusoro kuenda kune kana nyika dzakagadzirwa dzinoita zvinonzwisisika: zvinhu zvinogara zvakasimba, simba rinokwevera zvinhu pasi rinoshanda uye maoko anochengeta nhamba chaiyo yeminwe. Mabhenji akadai seVBench-2.0 uye physics-yakatarisana bvunzo seti inovavarira pane izvi, kazhinji ine multimodal mutauro modhi sevatongi, izvo zvinomutsa mibvunzo mitsva nezvekuti vanovimbika sei vatongi ivavo. Zvikamu zvirefu, odhiyo uye kamera yekudzora inodawo ma metrics ayo ezvino masutu anongovhara chikamu. Nhandare dzevanhu dzinogona kuramba dzakakosha nekuti dzinotora zvadzinoda, asi dzinodhura, dzinonzwa kuratidzwa uye dzakaoma kuburitsa, saka munda ungangoramba uchishandisa nzira dzese.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
VBench ndeye benchmark suite yezvinyorwa-kune-vhidhiyo modhi. Inopatsanura mhando yevhidhiyo kuita 16 mativi akapatsanurwa, akadai sekuenderana kwechinyorwa, kufamba kwakatsetseka, ine simba dhigirii uye aesthetic mhando, uye inoverengera imwe neimwe ine yakazvitsaurira otomatiki evaluator. Izvi zvine basa nekuti nhamba imwe chete haigone kuratidza kana vhidhiyo yakapinza, yakatsetseka, yakatendeka kune yayo nekukurumidza uye inofamba chaizvo, uye VBench inoita kuti izvo zvekutengesa zvionekwe.
VBench inotsemura mhando yekugadzirwa kwevhidhiyo muzvikamu gumi nematanhatu, zvakaiswa mumhando yevhidhiyo uye kuenderana kwevhidhiyo.
Dhigirii reDynamic rinoshandisa kuyerera kwemaziso kuyera kuti inofamba sei vhidhiyo. Klipu yakaomeswa ine zvibodzwa zvakaderera pano kunyangwe iine zvibodzwa zvakakwirira pakuenderana.
Kusaenderana kwechidzidzo kunoenzanisa maDINO maficha echinyorwa pamafuremu kutarisa kuti anoramba akafanana.
Vhidhiyo mhando zviyero zvinotonga clip zvisinei nekukasira, ukuwo vhidhiyo-condition kusachinja-chinja zviyero zvinotonga kuti vhidhiyo inotevera sei kukurumidza kwayo.
Huwandu hwemaavhareji hunoenderana. Kuenderana kwepamusoro kunogona kuvanza kufamba kwakaderera, saka per-dimension mhedzisiro ine basa.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Evaluating Recommender Systems: NDCG, Hit Rate and More
Tekinoroji