Overview
Fréchet Inception Distance (FID) ndiyo yakajairwa metric yekutarisa kuti ndeyechokwadi uye yakasiyana sei seti yemifananidzo yakagadzirwa. Inofananidza huwandu hwemifananidzo chaiyo uye yakagadzirwa munzvimbo yakadzika yenzvimbo - zvibodzwa zvakaderera zvinoreva kuti fakes inotaridzika padhuze nechinhu chaicho.
Fréchet Inception Distance ndeyekombuta-yekuona workflows inodudzira kana kugadzira midhiya yekuona yekuongorora, mashandiro, uye kugadzira.
Deep Dive
FID, yakaunzwa naHeusel et al. muna 2017, yakagadzirisa kukanganisa kwakakosha mune yekutanga Inception Score: haina kumboenzanisa mifananidzo yakagadzirwa kune chaiyo chaiyo data. FID inodyisa mifananidzo chaiyo uye yakagadzirwa kuburikidza neyakadzidziswa Inception-v3 network uye inoverenga 2048-dimensional feature vector kubva pakadzika pooling layer yemufananidzo wega wega. Inobva yaenzanisira seti yega yega seGaussian ine multivariate, ichipfupisa neanoreva vector uye covariance matrix. Nhambwe iri pakati pemaGaussia maviri inoverengerwa neFréchet chinhambwe (chinonziwo 2-Wasserstein chinhambwe). Iyo yakaderera FID inoreva iyo inogadzirwa yekugovera zvinoreva uye kupararira zvakanyanya kufanana nemifananidzo chaiyo, kutora ese ari maviri kuvimbika (anotaridzika chaizvo?)
Technical Insight
Iyo FID fomula ndiyo yakapetwa mutsauko weaya maviri anoreva mavekita pamwe nekutsvaga kwe (huwandu hwe covariances kubvisa kaviri matrix square midzi yechigadzirwa chavo). Nekuti inoshandisa yakazara covariance, FID inoranga zvese zvakasvibirira, zvisingaite zvinobuda uye modhi inodonha apo modhi inoburitsa yakawandisa akasiyana. Inonzwa kune saizi yemuenzaniso - yakawandisa mifananidzo inorerekera fungidziro kumusoro - saka varapi vanowanzo verenga pamusoro pemakumi ezviuru emifananidzo, kazhinji 50,000.
Kudzidzira Fréchet Inception Distance
Fréchet Inception Distance (FID) ndiyo yakajairwa metric yekutarisa kuti ndeyechokwadi uye yakasiyana sei seti yemifananidzo yakagadzirwa. Inofananidza huwandu hwemifananidzo chaiyo uye yakagadzirwa munzvimbo yakadzika yenzvimbo - zvibodzwa zvakaderera zvinoreva kuti fakes inotaridzika padhuze nechinhu chaicho. Fréchet Inception Distance ndeyekombuta-yekuona workflows inodudzira kana kugadzira midhiya yekuona yekuongorora, mashandiro, uye kugadzira. Kuti uvake kunzwisisa kwakadzama, bata Fréchet Inception Distance semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodikanwa, tsanangura fungidziro, uye patsanura izvo zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Fréchet Inception Distance chiyero chekuenzanisa nezvinoitika zvekushanda semhando yedata, kusiyana kwemwenje, uye kuenderana kwemazita. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero. Panguva imwecheteyo, kodzero dzeMufananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana hunhu husina kujeka. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Benchmarking GANs seStyleGAN, uko zvikwata zvinoshuma FID pamadhata seFFHQ kuenzanisa mhando yechizvarwa chechiso.
Kuteedzera kufambira mberi kwekudzidziswa kwemhando yekuparadzira nekombuta yeFID panzvimbo dzekutarisa kuti uone kana mhando yemufananidzo yamira kuvandudzika.
Kufananidza kukwikwidza mameseji-kune-mufananidzo modhi pane COCO dhata, uko yakaderera FID inotaurwa sehumbowo hwezvimwe zvinogoneka zvinobuda.
Kuona modhi inodonha mujenareta, sezvo FID's covariance term inosimuka kana modhi ichigadzira kushoma kwemifananidzo kusiyanisa.
Maitiro Ekuita
Fréchet Inception Distance mukuita
Benchmarking GANs seStyleGAN, uko zvikwata zvinoshuma FID pamadhata seFFHQ kuenzanisa mhando yechizvarwa chechiso.
Benchmarking GANs akadai seStyleGAN, uko zvikwata zvinoshuma FID pamadataseti seFFHQ kuenzanisa chiso-chizvarwa chemhando Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Fréchet Inception Distance mukuita
Kuteedzera kufambira mberi kwekudzidziswa kwemhando yekuparadzira nekombuta yeFID panzvimbo dzekutarisa kuti uone kana mhando yemufananidzo yamira kuvandudzika.
Kuteedzera kufambira mberi kwekudzidziswa kweiyo yekuparadzira modhi nekombuta yeFID panzvimbo dzekutarisa kuti uone kana mhando yemufananidzo yamira kuvandudza Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Fréchet Inception Distance mukuita
Kufananidza kukwikwidza mameseji-kune-mufananidzo modhi pane COCO dhata, uko yakaderera FID inotaurwa sehumbowo hwezvimwe zvinogoneka zvinobuda.
Kufananidza kukwikwidza mameseji-kune-mufananidzo modhi pane COCO dhata, uko yakaderera FID inodudzwa sehumbowo hwezvakawanda zvinobuda Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye kukanganisa mutengo nekufamba kwenguva.
Fréchet Inception Distance mukuita
Kuona modhi inodonha mujenareta, sezvo FID's covariance term inosimuka kana modhi ichigadzira kushoma kwemifananidzo kusiyanisa.
Kuona modhi inodonha mujenareta, sezvo FID's covariance term inosimuka kana modhi ichigadzira kushoma kwemifananidzo kusiyanisa Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.