Amabwiriza ya AI

AnimateDiff Motion Generation

AnimateDiff ni tekinike yongerera icyerekezo cyimyandikire-yerekana-ishusho yo gukwirakwiza nka Stable Diffusion, ihindura amashusho yerekana amashusho mo amashanyarazi magufi atarinze kongera kwerekana moderi yose.

Incamake

AnimateDiff ni tekinike yongerera icyerekezo cyimyandikire-yerekana-ishusho yo gukwirakwiza nka Stable Diffusion, ihindura amashusho yerekana amashusho mo amashanyarazi magufi atarinze kongera kwerekana moderi yose. Nibyingenzi kuko ireka ecosystem nini ya moderi yerekana amashusho hamwe nuburyo bwihariye butanga animasiyo ihendutse.

AnimateDiff Motion Generation ni iyumurimo wa mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga.

Kwibira cyane

AnimateDiff ikora mugutoza 'module module' itandukanye kumashusho ya videwo hanyuma ugacomeka iyo module muburyo bukonje, bumaze gutozwa amashusho yo gukwirakwiza nka Stable Diffusion. Ishusho yerekana ishusho iracyakora isura, imiterere, nibirimo, mugihe module yimikorere yiga uburyo pigiseli igomba kugenda kandi ikaguma kumurongo. Icy'ingenzi, kubera ko icyitegererezo fatizo gikomeza gukonjeshwa, module imwe irashobora kumanikwa ku bihumbi n’ibihumbi byiza byabaturage hamwe na LoRAs, bityo umukoresha akamenyero anime, gufotora, cyangwa kugenzura amarangi atunguranye. Ibisubizo mubisanzwe ni clip ngufi ya 16 frame. Nyuma verisiyo yongeweho icyerekezo LoRAs kugirango igenzure kamera (pan, zoom, umuzingo) na SparseCtrl kugirango itondekanye kumurongo mike yo kuyobora.

Ubushishozi

Icyerekezo module yinjizwemo nkibitekerezo byigihe gito hagati yimiterere ihari ya U-Net. Mugihe cyo kwerekana, buri kintu gishobora kwitabira kurindi zina mugihe cyigihe, bityo isura cyangwa ikintu cyakozwe mugice cya 1 kiguma gihuje kumurongo 8. Gusa ibyo byiciro byigihe gito byatojwe kuri videwo; uburemere bwibibanza ntibukoraho, niyo mpamvu utabishaka neza-shusho yerekana ishusho ikomeza guhuzwa.

Kumenya AnimateDiff Motion Generation

AnimateDiff ni tekinike yongerera icyerekezo cyimyandikire-yerekana-ishusho yo gukwirakwiza nka Stable Diffusion, ihindura amashusho yerekana amashusho mo amashanyarazi magufi atarinze kongera kwerekana moderi yose. Nibyingenzi kuko ireka ecosystem nini ya moderi yerekana amashusho hamwe nuburyo bwihariye butanga animasiyo ihendutse. AnimateDiff Motion Generation ni iyumurimo wa mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga. Kugirango wubake byimbitse, fata AnimateDiff Motion Generation nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mubimenyerezo, amakipe akomeye akoresha AnimateDiff Motion Generation iringaniza neza hamwe nibikorwa bifatika nkubwiza bwamakuru, itandukaniro ryamatara, hamwe nibirango bihoraho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza ha AnimateDiff Motion Generation

AnimateDiff yakemuye icyuho mbere yerekana amashusho yabigenewe, kandi filozofiya yayo icomeka ikomeza kugira uruhare mu murima. Tegereza icyerekezo cyimikorere kugirango ushyigikire amashusho maremare, imiterere ihanitse, hamwe na kamera ikarishye hamwe no kugenzura inzira, wongeyeho guhuza hamwe na ControlNet-yubuyobozi. Nka videwo nini ya videwo ikwirakwizwa hamwe na moderi yerekana amashusho akuze, imiterere ya adaptate ya AnimateDiff irashobora gukomeza kuba iyagaciro muguhindura bihendutse isomero rinini ryibikoresho byabigenewe byihariye, byerekana amashusho yerekana amashusho manini adasubiramo.

Gushyira mu bikorwa Isi

Kwerekana Anime-Imiterere yihariye ya Stable Diffusion igenzura mumashusho mugufi

Ongeraho kamera itinda zoom cyangwa isafuriya ahantu nyaburanga hakoreshejwe icyerekezo LoRA

Gukora uduce duto twa animasiyo cyangwa imbuga nkoranyambaga zivuye mu nyandiko imwe

Koresha SparseCtrl hamwe na couple ebyiri zingenzi kugirango uyobore inzibacyuho hagati yimyanya ibiri

Uburyo bwo Gushyira mu bikorwa

AnimateDiff Motion Generation mubikorwa

Kwerekana Anime-Imiterere yihariye ya Stable Diffusion igenzura mumashusho mugufi.

Kwerekana uburyo bwihariye bwa anime-Imiterere ihamye ya Diffusion igenzurwa mugice kigufi cyerekana imiterere Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.

AnimateDiff Motion Generation mubikorwa

Ongeraho kamera itinda zoom cyangwa isafuriya ahantu nyaburanga hakoreshejwe icyerekezo LoRA.

Ongeraho kamera gahoro kamera cyangwa isafuriya ahantu nyaburanga hakoreshejwe icyerekezo Amakipe ya LoRA mubisanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

AnimateDiff Motion Generation mubikorwa

Gukora uduce duto twa animasiyo cyangwa imbuga nkoranyambaga zivuye mu nyandiko imwe.

Gukora uduce duto twa animasiyo cyangwa imbuga nkoranyambaga zivuye kumurongo umwe wanditse Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

AnimateDiff Motion Generation mubikorwa

Koresha SparseCtrl hamwe na couple ebyiri zingenzi kugirango uyobore inzibacyuho hagati yimyanya ibiri.

Gukoresha SparseCtrl hamwe nibintu bibiri byingenzi kugirango uyobore inzibacyuho hagati yimikino ibiri Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

!

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

!

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi