Gutakaza Kubona na LPIPS
Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi.
Incamake
It matters because pixel-by-pixel comparison wrongly punishes tiny shifts and blurs detail, while perceptual loss rewards sharp, realistic results.
Kwibira cyane
Igihombo gakondo nka L2 (bivuze ikosa rya kare) gereranya amashusho pigiseli-kuri-pigiseli, bityo rero pigiseli imwe ihinduka cyangwa imiterere itandukanye gato isa nkikosa rikomeye nubwo abantu batabibona. Igihombo cyo kwiyumvisha ahubwo gikoresha amashusho yombi binyuze mumurongo wabigenewe (akenshi VGG) kandi ugereranya ibikorwa biva murwego rwagati. Kuberako ibyo biranga bikubiyemo impande, imiterere, nibice byibice aho kuba pigiseli nyayo ya pigiseli, igihombo gihuza neza nubucamanza bwabantu, bigatera imbaraga zisharira, zisobanutse. LPIPS (Yize Perceptual Image Patch isa), yatangijwe na Zhang n'abandi. muri 2018, ishyiraho ibi: ikuramo ibintu byimbitse, irabisanzwe, kandi ikoresha uburemere bwize bwerekanwe kubucamanza bwibihumbi n'ibihumbi bisa, bitanga amanota intera imwe aho hasi bisobanura byinshi muburyo bumwe.
Ubushishozi
LPIPS inyuza amashusho yombi binyuze mumugongo uhamye (VGG, AlexNet, cyangwa SqueezeNet), ubumwe-busanzwe ibikorwa byumuyoboro mubice byinshi, hanyuma bigafata itandukaniro rya kare kuri buri mwanya. Gitoya yize kuri buri muyoboro ipima umunzani utandukanya mbere yuko igereranwa ahantu hamwe kandi igahuzwa murwego. Ibyo bipimo byahuguwe kuri dataset ya BAPPS yimanza ebyiri-zindi-zihatira-guhitamo-guhitamo, bityo ibipimo byerekana ibyo abantu babona mubyukuri aho kuba intera ndende.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Igihe kizaza cyo gutakaza igihombo na LPIPS
Ibipimo bifatika bigenda biva kuri CNN umugongo werekeza kubintu bivuye kwiyobora no kwerekana icyerekezo gihindura nka DINO na CLIP, ifata ibisobanuro bikize. Tegereza guhuza cyane hamwe na diffuzion-moderi y'amahugurwa hamwe no gusuzuma inyandiko-ku-shusho, wongeyeho amanota yo gushishoza yahujwe na videwo yigihe gito. Abashakashatsi kandi barimo gukora ubushakashatsi ku mpumyi za LPIPS: irashobora gushukwa nabi kandi igahuza intege n’ubuziranenge mu budahemuka buhebuje, igatera ibipimo bishya bihuza abantu nka DISTS hamwe n’uburyo bwa ensemble.
Gushyira mu bikorwa Isi
Guhugura imiyoboro ihanitse cyane (urugero, SRGAN) kuburyo amafoto yo hejuru asa neza kandi afite imiterere aho kuba mubi.
Gusuzuma ishusho yogusenya hamwe na codecs mugutanga uburyo muburyo bwo gufunga ishusho ya decode iri kumwimerere.
Kuyobora uburyo bwo kwimura, aho ibirimo bihujwe binyuze muri VGG yimbitse kuruta pigiseli nyayo.
Ibipimo bya GAN hamwe nogukwirakwiza amashusho mugutanga intera ya LPIPS hagati yamashusho yakozwe nukuri.
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Perceptual Loss and LPIPS quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Igihombo Cyibanze Kumenyekanisha Kuringaniza
Ibibazo bikunze kubazwa
What is Perceptual Loss and LPIPS?
Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi. Nibyingenzi kuko pigiseli-kuri-pigiseli igereranya ihana nabi guhindagura utuntu duto no guhisha amakuru arambuye, mugihe igihombo cyo gushishoza giha ibihembo bikaze, bifatika.
Ni ukubera iki igihombo gishingiye kuri pigiseli L2 akenshi itahura nabi ishusho ugereranije nigihombo cyo kwiyumvisha ibintu?
L2 igereranya pigiseli itaziguye, bityo rero umwanya muto uhindagurika cyangwa itandukaniro ryimiterere byandikwa nkamakosa manini nubwo ishusho isa neza kumuntu.
Niki LPIPS igereranya cyane cyane hagati yamashusho abiri?
LPIPS ikuramo ibintu byimbitse biva mumugongo uhamye kandi bipima intera yabyo, ihuza neza imyumvire yabantu kuruta pigiseli.
Nigute uburemere bwa buri murongo muri LPIPS bwagenwe?
Ibipimo byize guhuza dataset nini (BAPPS) yabantu babiri-ubundi-bahatirwa-guhitamo ibyemezo bisa.
Nuwuhe muyoboro wumugongo uhujwe cyane no gutakaza ibintu bisanzwe (ibiranga)?
Ikarita yerekana hagati ya VGG yahindutse igipimo cyo gutakaza ubwenge mubikorwa nka super-resolution hamwe no kwimura imiterere.
Ni uwuhe murimo wungukirwa cyane no gukoresha igihombo aho gukoresha L2 yera?
Imiyoboro ihanitse cyane yatojwe hamwe nigihombo cyo kwiyumvisha ibintu itanga imiterere ikarishye, ifatika, mugihe L2 ikunda gutanga impuzandengo.