Amabwiriza ya AI

Tune-A-Video Imwe-imwe Guhindura

Hindura-A-Video neza-utegure neza inyandiko-yerekana-ishusho yo gukwirakwiza amashusho kuri videwo imwe kugirango ishobore kongera guhindura iyo clip kuva mumyandiko mishya.

Incamake

Hindura-A-Video neza-utegure neza inyandiko-yerekana-ishusho yo gukwirakwiza amashusho kuri videwo imwe kugirango ishobore kongera guhindura iyo clip kuva mumyandiko mishya. Nibyingenzi kuko byerekanaga ko udakeneye imibare nini ya mashusho kugirango ubone amashusho ayobora inyandiko.

Tune-A-Video Imwe-Shoti Guhindura ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kugirango risesengurwe, imikorere, no guhanga.

Kwibira cyane

Tune-A-Video, yatangijwe mu mpera za 2022, ikemura 'amashusho yerekana amashusho imwe': uyiha videwo imwe yinkomoko wongeyeho ibisobanuro, kandi iriga bihagije kugirango uhindure iyo videwo muburyo bushya (guhindura ingingo, imiterere, cyangwa ikiranga) mugihe ukomeza icyerekezo cyambere. Aho guhugura moderi yerekana amashusho kuva kera, yinjiza icyitegererezo cyanditse-ku-shusho (Stable Diffusion) muburyo bwa pseudo-videwo mu kwagura 2D imyanzuro no kwitondera mugihe cyigihe. Hanyuma irahuza neza gusa agace gato k'ibipimo kuri clip imwe. Mugusuzuma, DDIM ihinduranya yinkomoko yamakadiri ikomatanya imiterere bityo guhindura bigahoraho mugihe gito aho guhindagura ikadiri kumurongo.

Ubushishozi

Amayeri y'ingenzi ni 'kurasa rimwe' hamwe no kwitondera umwanya muto. Ishusho yicyitegererezo yo kwiyitaho irasubirwamo kuburyo buri kintu cyitabira kumurongo wambere hamwe nikibanza cyabanjirije, gukwirakwiza isura no kubahiriza icyerekezo. Gusa ibyitonderwa byerekanwa matrices (nibice byigihe gito) biravugururwa, bikomeza guhuza byihuse kandi bihendutse. Guhindura DDIM ihindura inkomoko yinkomoko yurusaku bityo ibisekuru bitangirira kumiterere-ibika ibanga aho kuba urusaku rudasanzwe.

Kumenyereza Tune-A-Video Imwe-imwe yo Guhindura

Hindura-A-Video neza-utegure neza inyandiko-yerekana-ishusho yo gukwirakwiza amashusho kuri videwo imwe kugirango ishobore kongera guhindura iyo clip kuva mumyandiko mishya. Nibyingenzi kuko byerekanaga ko udakeneye imibare nini ya mashusho kugirango ubone amashusho ayobora inyandiko. Tune-A-Video Imwe-Shoti Guhindura ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kugirango risesengurwe, imikorere, no guhanga. Kugirango wubake byimbitse, fata Tune-A-Video Guhindura-Shoti imwe nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha Tune-A-Video Imwe-Shoti Guhindura uburinganire bwuzuye hamwe nibikorwa bifatika nkubwiza bwamakuru, itandukaniro ryamatara, hamwe na label ihamye. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego.

AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza ha Tune-A-Video Imwe-imwe yo Guhindura

Tune-A-Video yabibye umurongo wabasimbuye badafite amajwi na zeru (Video-P2P, FateZero, Text2Video-Zero, Pix2Video) birinda imyitozo kuri buri clip. Icyerekezo ni uguhindura amashusho uko bishakiye ako kanya hamwe nimbaraga zikomeye zigihe gito na videwo kavukire ikwirakwizwa. Tegereza uburyo bumwe bwo gushira kugirango bishire nka moderi yerekana amashusho ya fondasiyo nka __AIU_PROTECTED_12 __- sisitemu yuburyo bukora, bwihuse-bwihuse bwo guhindura ibintu byubatswe aho kuba akazi keza neza.

Gushyira mu bikorwa-Isi

Guhindura clip ya 'man skiing' muri 'Spider-Man skiing' mugihe urinda icyerekezo cyambere cyo gushushanya

Gusubiramo amashusho yukuri-yimbwa muri Van Gogh cyangwa ibara ryamazi

Guhinduranya ibiranga ingingo, nko guhindura panda kurya imigano mo koala kurya imigano

Gukoresha prototyping ya animasiyo ngufi yamamaza muguhindura clip imwe yerekanwe hamwe nibisobanuro bitandukanye

Uburyo bwo Gushyira mu bikorwa

Tune-A-Video Imwe-Shoti Guhindura mubikorwa

Guhindura clip ya 'man skiing' muri 'Spider-Man skiing' mugihe urinda icyerekezo cyambere.

Guhindura clip ya 'man skiing' muri 'Spider-Man skiing' mugihe urinze icyerekezo cyambere cyo kubaza Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Tune-A-Video Imwe-Shoti Guhindura mubikorwa

Gusubiramo amashusho yukuri-yimbwa muri Van Gogh cyangwa ibara ryamazi.

Gusubiramo amashusho yukuri-yimbwa muri Van Gogh cyangwa ibara ryamazi ya Anamorike Amakipe mubisanzwe abona ibisubizo byiza iyo asobanuye ibipimo byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Tune-A-Video Imwe-Shoti Guhindura mubikorwa

Guhinduranya ibiranga ingingo, nko guhindura panda kurya imigano mo koala kurya imigano.

Guhinduranya ibiranga isomo, nko guhindura panda urya imigano mo koala urya imigano Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Tune-A-Video Imwe-Shoti Guhindura mubikorwa

Gukoresha prototyping ya animasiyo ngufi yamamaza muguhindura clip imwe yerekanwe hamwe nibisobanuro bitandukanye.

Gukoresha prototyping ya animasiyo ngufi yamamaza muguhindura clip imwe yerekanwe hamwe nibisobanuro bitandukanye Amakipe akunze kubona ibisubizo byiza mugihe asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

Ingaruka & Kurinda

!

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

!

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

!

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi