Amabwiriza ya AI

Gutakaza Kubona na LPIPS

Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi.

Incamake

Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi. Nibyingenzi kuko pigiseli-kuri-pigiseli igereranya ihana nabi guhindagura utuntu duto no guhisha amakuru arambuye, mugihe igihombo cyo gushishoza giha ibihembo bikaze, bifatika.

Gutakaza Gutakaza na LPIPS ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga.

Kwibira cyane

Igihombo gakondo nka L2 (bivuze ikosa rya kare) gereranya amashusho pigiseli-kuri-pigiseli, bityo rero pigiseli imwe ihinduka cyangwa imiterere itandukanye gato isa nkikosa rikomeye nubwo abantu batabibona. Igihombo cyo kwiyumvisha ahubwo gikoresha amashusho yombi binyuze mumurongo wabigenewe (akenshi VGG) kandi ugereranya ibikorwa biva murwego rwagati. Kuberako ibyo biranga bikubiyemo impande, imiterere, nibice byibice aho kuba pigiseli nyayo ya pigiseli, igihombo gihuza neza nubucamanza bwabantu, bigatera imbaraga zisharira, zisobanutse. LPIPS (Yize Perceptual Image Patch isa), yatangijwe na Zhang n'abandi. muri 2018, ishyiraho ibi: ikuramo ibintu byimbitse, irabisanzwe, kandi ikoresha uburemere bwize bwerekanwe kubucamanza bwibihumbi n'ibihumbi bisa, bitanga amanota intera imwe aho hasi bisobanura byinshi muburyo bumwe.

Ubushishozi

LPIPS inyuza amashusho yombi binyuze mumugongo uhamye (VGG, AlexNet, cyangwa SqueezeNet), ubumwe-busanzwe ibikorwa byumuyoboro mubice byinshi, hanyuma bigafata itandukaniro rya kare kuri buri mwanya. Gitoya yize kuri buri muyoboro ipima umunzani utandukanya mbere yuko igereranwa ahantu hamwe kandi igahuzwa murwego. Ibyo bipimo byahuguwe kuri dataset ya BAPPS yimanza ebyiri-zindi-zihatira-guhitamo-guhitamo, bityo ibipimo byerekana ibyo abantu babona mubyukuri aho kuba intera ndende.

Kumenya Gutakaza Kubona na LPIPS

Igihombo cyo kwiyumvisha gipima uburyo amashusho abiri asa nabantu mugereranya ibintu byimbitse byurusobe aho kuba pigiseli mbisi. Nibyingenzi kuko pigiseli-kuri-pigiseli igereranya ihana nabi guhindagura utuntu duto no guhisha amakuru arambuye, mugihe igihombo cyo gushishoza giha ibihembo bikaze, bifatika. Gutakaza Gutakaza na LPIPS ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga. Kugirango wubake byimbitse, fata Perceptual Loss na LPIPS nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha igihombo cya Perceptual Loss na LPIPS iringaniza neza hamwe nibikorwa bifatika nkubwiza bwamakuru, itandukaniro ryamatara, hamwe na labels bihoraho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Igihe kizaza cyo gutakaza igihombo na LPIPS

Ibipimo bifatika bigenda biva kuri CNN umugongo werekeza kubintu bivuye kwiyobora no kwerekana icyerekezo gihindura nka DINO na CLIP, ifata ibisobanuro bikize. Tegereza guhuza cyane hamwe na diffuzion-moderi y'amahugurwa hamwe no gusuzuma inyandiko-ku-shusho, wongeyeho amanota yo gushishoza yahujwe na videwo yigihe gito. Abashakashatsi kandi barimo gukora ubushakashatsi ku mpumyi za LPIPS: irashobora gushukwa nabi kandi igahuza intege n’ubuziranenge mu budahemuka buhebuje, igatera ibipimo bishya bihuza abantu nka DISTS hamwe n’uburyo bwa ensemble.

Gushyira mu bikorwa Isi

Guhugura imiyoboro ihanitse cyane (urugero, SRGAN) kuburyo amafoto yo hejuru asa neza kandi afite imiterere aho kuba mubi.

Gusuzuma ishusho yogusenya hamwe na codecs mugutanga uburyo muburyo bwo gufunga ishusho ya decode iri kumwimerere.

Kuyobora uburyo bwo kwimura, aho ibirimo bihujwe binyuze muri VGG yimbitse kuruta pigiseli nyayo.

Ibipimo bya GAN hamwe nogukwirakwiza amashusho mugutanga intera ya LPIPS hagati yamashusho yakozwe nukuri.

Uburyo bwo Gushyira mu bikorwa

Gutakaza Kubona na LPIPS mubikorwa

Guhugura imiyoboro ihanitse cyane (urugero, SRGAN) kuburyo amafoto yo hejuru asa neza kandi afite imiterere aho kuba mubi.

Guhugura imiyoboro ihanitse cyane (urugero, SRGAN) kuburyo amafoto yazamutse asa neza kandi afite imiterere aho guhubuka Amakipe ubusanzwe abona ibisubizo byiza mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Gutakaza Kubona na LPIPS mubikorwa

Gusuzuma ishusho yogusenya hamwe na codecs mugutanga uburyo muburyo bwo gufunga ishusho ya decode iri kumwimerere.

Gusuzuma igabanuka ryamashusho hamwe na codecs ukoresheje amanota muburyo bwo gufunga ishusho ya decode iri mumakipe yumwimerere mubisanzwe abona ibisubizo byiza mugihe basobanuye ibipimo byimbere imbere, bagakomeza inzira yo kuzamuka kwabantu kubibazo byimbere, kandi bagakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Gutakaza Kubona na LPIPS mubikorwa

Kuyobora uburyo bwo kwimura, aho ibirimo bihujwe binyuze muri VGG yimbitse kuruta pigiseli nyayo.

Kuyobora uburyo bwo kwimura, aho ibirimo bihujwe hakoreshejwe ibintu byimbitse bya VGG aho kuba pigiseli nyayo Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.

Gutakaza Kubona na LPIPS mubikorwa

Ibipimo bya GAN hamwe nogukwirakwiza amashusho mugutanga intera ya LPIPS hagati yamashusho yakozwe nukuri.

Ibipimo byerekana GAN hamwe nogukwirakwiza amashusho mugutangaza intera ya LPIPS hagati yamashusho yakozwe kandi nyayo Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

!

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

!

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi