Overview
SPADE (Spatially-Adaptive Normalization) inoshandura chimiro chakareruka chakanyorwa, semepu yebhuku remwana re'denga pano, uswa uko, muti pano', kuita mufananidzo wemifananidzo. Izvo zvine basa nekuti zvinopa maartist uye vagadziri kwakaringana kutonga kwenzvimbo pane izvo zvinoonekwa pane inogadzirwa chiitiko.
SPADE Semantic Image Synthesis ndeyekombuta-kuona mafambiro anodudzira kana kugadzira midhiya yekuona yekuongorora, mashandiro, uye kugadzira.
Deep Dive
SPADE, yakaunzwa neNVIDIA vaongorori Park, Liu, Wang, uye Zhu muna 2019 (ine demo app GauGAN), inogadzira mifananidzo yechokwadi kubva semantic segmentation mepu, uko pixel yega yega inopendwa nechikamu chayo (mvura, mugwagwa, chivakwa, denga). Majenareta ekare akadyisa mepu yezvikamu kuburikidza neyakajairwa maseru ayo aiita 'kusuka' ruzivo rwehurongwa, achiburitsa blurry kana kusawirirana. Maonero eSPADE ndeekuti dhizaini inofanirwa kuramba ichitungamira network padanho rega rega rechizvarwa, kwete chete pakupinza. Iyo inogadziridza iyo yakajairwa activation ichishandisa ma parameter akadzidzwa zvakananga kubva kumepu yezvikamu panzvimbo yega yega. Mhedzisiro yacho inopinza, inodzoreka synthesis kwaunogona kupenda mepu ine zita uye wotarisa inotendeseka nyika, izere neanoratidza uye maumbirwo, inobatika.
Technical Insight
Batch yakajairwa kana semuenzaniso kuenzanisa zvikero uye mashifiti ma activation ane imwechete yakadzidzwa tsika pachiteshi, achirasa ruzivo rwenzvimbo. SPADE pachinzvimbo inofanotaura chiyero (gamma) uye chinja (beta) seyakazara nzvimbo tensors yakaverengerwa nediki convolutional layer inoiswa kune segmentation mask. Aya maparamendi anosiyana-siyana anobaiwa pazvisarudzo zvakawanda mukati mejenareta, saka iyo semantic dhizaini inoramba ichigadzirisa zvinobuda uye inodzivirira ruzivo kubva kune yakajairika kure.
Mastering SPADE Semantic Image Synthesis
SPADE (Spatially-Adaptive Normalization) inoshandura chimiro chakareruka chakanyorwa, semepu yebhuku remwana re'denga pano, uswa uko, muti pano', kuita mufananidzo wemifananidzo. Izvo zvine basa nekuti zvinopa maartist uye vagadziri kwakaringana kutonga kwenzvimbo pane izvo zvinoonekwa pane inogadzirwa chiitiko. SPADE Semantic Image Synthesis ndeyekombuta-kuona mafambiro anodudzira kana kugadzira midhiya yekuona yekuongorora, mashandiro, uye kugadzira. Kuti uvake kunzwisisa kwakadzama, bata SPADE Semantic Image Synthesis semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodiwa, kujekesa fungidziro, uye patsanura izvo zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa SPADE Semantic Image Synthesis kuenzanirana nehuchokwadi hwekushanda semhando yedata, kusiyana kwemwenje, uye kuenderana kwemazita. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero. Panguva imwecheteyo, kodzero dzeMufananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana hunhu husina kujeka. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
NVIDIA's GauGAN/Canvas app, ichirega vashandisi kupendi yakaomarara segmentation mepu inova mafotorealistic landscapes.
Architectural uye mutambo-level concepting, uko vagadziri vanodhirowa nzvimbo uye vanowana yekuona chiitiko
Kugadzira akasiyana-siyana ekudzidzira mapikicha ane anozivikanwa mapixel mavara eiyo segmentation modhi yekuvandudza
Maturusi ekugadzirisa mafoto anoita kuti vashandisi vanyorezve matunhu (shandura huswa huve mvura) uye gadzirazve nzvimbo iyoyo zvine musoro.
Maitiro Ekuita
SPADE Semantic Image Synthesis mukuita
NVIDIA's GauGAN/Canvas app, ichirega vashandisi kupendera akaomesesa segmentation mepu inova mafotorealistic landscapes.
NVIDIA's GauGAN/Canvas app, ichirega vashandisi kupendera akaomesesa zvikamu zvemepu izvo zvinova mafotorealistic landscapes Matimu anowanzo kuwana zvirinani kana achinge atsanangura emhando yepamusoro kumberi, chengeta nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
SPADE Semantic Image Synthesis mukuita
Architectural and game-level concepting, uko vagadziri vanodhirowa nzvimbo uye vanowana maonerwo ezviitiko ipapo.
Yekuvaka uye yemutambo-level concepting, uko vagadziri vanodhirowa nzvimbo uye vanowana ipapo yekutarisisa chiitiko Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
SPADE Semantic Image Synthesis mukuita
Kugadzira akasiyana-siyana ekudzidzira mapikicha ane anozivikanwa mapixel mavara eiyo segmentation modhi yekuvandudza.
Kugadzira akasiyana-siyana ekudzidzira mapikicha ane anozivikanwa mapixel mavara eiyo segmentation modhi yekuvandudza Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
SPADE Semantic Image Synthesis mukuita
Maturusi ekugadzirisa mafoto anoita kuti vashandisi vanyorezve matunhu (shandura huswa huve mvura) uye gadzirazve nzvimbo iyoyo nemazvo.
Maturusi ekugadzirisa mafoto anoita kuti vashandisi vadzore matunhu (shandura huswa huve mvura) uye kugadzirisazve nzvimbo iyoyo nemazvo Matimu anowanzo kuwana mibairo iri nani kana achinge atsanangura hunhu hwepamberi, chengetedza nzira yekukwira kwevanhu yemakesi emumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.