CodeFormer Robust Face Kudzoreredza
CodeFormer imhando yekudzoreredza kumeso yakavakirwa kubata kushatisa kwakanyanya, kudzoreredza zviso zvinozivikanwa kubva kune zvakakuvadzwa zvakanyanya, zvidiki, kana kusajeka.
Pfupiso
It matters because it lets users dial the trade-off between staying faithful to the original and producing a clean, high-quality result.
Kudzika Kwakadzika
CodeFormer (NeurIPS 2022) inodzoreredza kudzoreredza kwechiso sekufembera kwekodhi kodhi panzvimbo yekuenderera mberi pixel regression. Inotanga kudzidzisa VQGAN-style codebook: diki, rakadzidzwa duramazwi rechiso 'yekuvaka zvidhinha' rinotora zvemhando yepamusoro kumeso. Zvichipiwa chiso chakashata, Transformer inofanotaura kuti ndeipi codebook inopinda inyatsoivaka patsva, inobata kudzoreredza sekutora ma tokeni chaiwo kubva muduramazwi rezvikamu zvechiso. Nekuti iyo codebook inogara munzvimbo ine compact, ine magumo, modhi yacho yakasimba zvakanyanya kusvika kune ruzha rwakanyanya uye kusajeka kupfuura nzira dzinoita mapixels zvakananga. A controllable feature transformation module inoita kuti vashandisi vatsvedze huremu humwe (hunowanzonzi kutendeka) kuti vafarire zvakapinza, zvinonyatsobuditsa kubuda kana kutendeka kwakasimba kune yakakuvadzwa kuisa.
Technical Insight
Iro discrete codebook rinoita senge rakasimba rakapfuura rine mashoma 'vocabulary', saka kunyangwe iyo yekuisa yashatiswa zvakanyanya Transformer inogona kuramba ichifembera kune echokwadi, emhando yepamusoro macode. Iyi modhi yepasirese kuburikidza nekutarisa inoderedza kutsamira pane emuno pixel cues iyo inoparadza inoparadza. Iyo inogadziriswa kutendeseka huremu inodzora kuti yakawanda sei network inotsamira pane iyo yekuisa maficha maringe neyakadzidzwa codebook, yekutengesa chitupa chekuchengetedza kupesana nekubuda kwehutsanana.
Strategic Impact
Kumhanya uye chiyero
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Vaka sarudzo
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Team uye workflow
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Ramangwana reCodeFormer Robust Face Recovery
Codebook-plus-Transformer madhizaini ari kupesvedzera kudzoreredza kwakakura uye basa rechizvarwa, uye CodeFormer iri kuwedzera kusanganiswa nekunatswa kwekunatsiridza kune kunyangwe crisper mhedzisiro. Tarisira zvirinani zvenguva vhezheni zvevhidhiyo, kukiya chiziviso chakanaka kuitira kuti kudzoreredza kurege kuchinjanisa chimiro chemunhu, uye kusanganisa kwakasimba mumapurogiramu emifananidzo yevatengi. Sezvinei zvese zvinodzoreredza kumeso, kubuda pachena nezve zvakavakwazve uye kushandiswa zvisizvo kuchengetedza kuchakura mukukosha.
Real-World Implementation
Kudzoreredza zviso kubva kune yakanyanya kuderera-resolution yekutarisa kana yezvinyorwa zvinyorwa
Kudzoreredza kukuvara zvakanyanya, kupera, kana pixelated nhoroondo yemifananidzo
Kugadzirisa mifananidzo inogadzirwa neAI apo zviso zvakadonha kuita kusajeka kana kukanganisa
Rega vashandisi kurongedza kutendeseka kutsvedza kusarudza pakati pekutendeka kana kukwenenzverwa kudzoreredza
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the CodeFormer Robust Face Recovery quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
LaMa Resolution-Robust Inpainting
Mibvunzo inowanzo bvunzwa
What is CodeFormer Robust Face Recovery?
CodeFormer imhando yekudzoreredza kumeso yakavakirwa kubata kushatisa kwakanyanya, kudzoreredza zviso zvinozivikanwa kubva kune zvakakuvadzwa zvakanyanya, zvidiki, kana kusajeka. Izvo zvine basa nekuti zvinoita kuti vashandisi vafonere kutengeserana pakati pekugara wakatendeka kune yekutanga uye kuburitsa yakachena, yemhando yepamusoro mhedzisiro.
Ko CodeFormer inogadzirisa sei dambudziko rekudzoreredza kumeso?
CodeFormer inofanotaura zvinyorwa zvakasarudzika kubva kuVQGAN-maitiro kodhi bhuku, inobata kudzoreredza sekusarudza tokeni pane kudzoreredza mapixels.
Ndechipi chikamu chinofanotaura kuti ndezvipi zvinyorwa zvecodebook zvichashandiswa?
A Transformer modhi yepasirese mamiriro ekufanotaura akanakisa codebook tokeni, ayo akasimba kupfuura kuvimba nepixel cues emuno.
Sei iyo discrete codebook ichibatsira kune zvakadzikiswa zvakanyanya?
Nekuti fungidziro dzinosvika kune yakaganhurwa seti yemhando yepamusoro-soro macode, modhi inoramba yakasimba kunyangwe mapikisi ekuisa akashatiswa zvakanyanya.
Chii chinonzi CodeFormer chinogadziriswa kutendeka uremu kudzora?
Iyo inodzoreka chimiro shanduko inoita kuti vashandisi vatsvedze pakati pekuchengetedza chitupa chepakutanga uye kugadzira yakachena, inopinza mhedzisiro.
Ndeipi nzvimbo yakadhindwa CodeFormer?
CodeFormer yakaunzwa paNeurIPS 2022, ichipa nzira yayo yekutarisa codebook yekudzoreredza chiso kwakasimba.