Amabwiriza ya AI

Gutakaza Kubona na LPIPS

Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi.

Incamake

Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi. Nibyingenzi kuko pigiseli-kuri-pigiseli igereranya ihana nabi guhindagura utuntu duto no guhisha amakuru arambuye, mugihe igihombo cyo gushishoza giha ibihembo bikaze, bifatika.

Gutakaza Gutakaza na LPIPS ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga.

Kwibira cyane

Igihombo gakondo nka L2 (bivuze ikosa rya kare) gereranya amashusho pigiseli-kuri-pigiseli, bityo rero pigiseli imwe ihinduka cyangwa imiterere itandukanye gato isa nkikosa rikomeye nubwo abantu batabibona. Igihombo cyo kwiyumvisha ahubwo gikoresha amashusho yombi binyuze mumurongo wabigenewe (akenshi VGG) kandi ugereranya ibikorwa biva murwego rwagati. Kuberako ibyo biranga bikubiyemo impande, imiterere, nibice byibice aho kuba pigiseli nyayo ya pigiseli, igihombo gihuza neza nubucamanza bwabantu, bigatera imbaraga zisharira, zisobanutse. LPIPS (Yize Perceptual Image Patch isa), yatangijwe na Zhang n'abandi. muri 2018, ishyiraho ibi: ikuramo ibintu byimbitse, irabisanzwe, kandi ikoresha uburemere bwize bwerekanwe kubucamanza bwibihumbi n'ibihumbi bisa, bitanga amanota intera imwe aho hasi bisobanura byinshi muburyo bumwe.

Ubushishozi

LPIPS inyuza amashusho yombi binyuze mumugongo uhamye (VGG, AlexNet, cyangwa SqueezeNet), ubumwe-busanzwe ibikorwa byumuyoboro mubice byinshi, hanyuma bigafata itandukaniro rya kare kuri buri mwanya. Gitoya yize kuri buri muyoboro ipima umunzani utandukanya mbere yuko igereranwa ahantu hamwe kandi igahuzwa murwego. Ibyo bipimo byahuguwe kuri dataset ya BAPPS yimanza ebyiri-zindi-zihatira-guhitamo-guhitamo, bityo ibipimo byerekana ibyo abantu babona mubyukuri aho kuba intera ndende.

Kumenya Gutakaza Kubona na LPIPS

Kugirango wubake byimbitse, fata Perceptual Loss na LPIPS nkicyitegererezo gikora, ntabwo ari ikintu kimwe. Sobanura ibyifuzwa, usobanure neza ibitekerezo, kandi utandukanye ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha igihombo cya Perceptual Loss na LPIPS iringaniza neza hamwe nibikorwa bifatika nkubwiza bwamakuru, itandukaniro ryamatara, hamwe na labels bihoraho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Igihe kizaza cyo gutakaza igihombo na LPIPS

Ibipimo bifatika bigenda biva kuri CNN umugongo werekeza kubintu bivuye kwiyobora no kwerekana icyerekezo gihindura nka DINO na CLIP, ifata ibisobanuro bikize. Tegereza guhuza cyane hamwe na diffuzion-moderi y'amahugurwa hamwe no gusuzuma inyandiko-ku-shusho, wongeyeho amanota yo gushishoza yahujwe na videwo yigihe gito. Abashakashatsi kandi barimo gukora ubushakashatsi ku mpumyi za LPIPS: irashobora gushukwa nabi kandi igahuza intege n’ubuziranenge mu budahemuka buhebuje, igatera ibipimo bishya bihuza abantu nka DISTS hamwe n’uburyo bwa ensemble.

Gushyira mu bikorwa Isi

Guhugura imiyoboro ihanitse cyane (urugero, SRGAN) kuburyo amafoto yo hejuru asa neza kandi afite imiterere aho kuba mubi.

Gusuzuma ishusho yogusenya hamwe na codecs mugutanga uburyo muburyo bwo gufunga ishusho ya decode iri kumwimerere.

Kuyobora uburyo bwo kwimura, aho ibirimo bihujwe binyuze muri VGG yimbitse kuruta pigiseli nyayo.

Ibipimo bya GAN hamwe nogukwirakwiza amashusho mugutanga intera ya LPIPS hagati yamashusho yakozwe nukuri.

Uburyo bwo Gushyira mu bikorwa

Gutakaza Kubona na LPIPS mubikorwa

Guhugura imiyoboro ihanitse cyane (urugero, SRGAN) kuburyo amafoto yo hejuru asa neza kandi afite imiterere aho kuba mubi.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Gutakaza Kubona na LPIPS mubikorwa

Gusuzuma ishusho yogusenya hamwe na codecs mugutanga uburyo muburyo bwo gufunga ishusho ya decode iri kumwimerere.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Gutakaza Kubona na LPIPS mubikorwa

Kuyobora uburyo bwo kwimura, aho ibirimo bihujwe binyuze muri VGG yimbitse kuruta pigiseli nyayo.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Gutakaza Kubona na LPIPS mubikorwa

Ibipimo bya GAN hamwe nogukwirakwiza amashusho mugutanga intera ya LPIPS hagati yamashusho yakozwe nukuri.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

!

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

!

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi

Check your understanding

Test yourself: take the Perceptual Loss and LPIPS quiz

Start quiz