AnimateDiff Motion Generation
AnimateDiff ni tekinike yongerera icyerekezo cyimyandikire-yerekana-ishusho yo gukwirakwiza nka Stable Diffusion, ihindura amashusho yerekana amashusho mo amashanyarazi magufi atarinze kongera kwerekana moderi yose.
Incamake
It matters because it lets the huge ecosystem of image models and custom styles produce animation cheaply.
Kwibira cyane
AnimateDiff ikora mugutoza 'module module' itandukanye kumashusho ya videwo hanyuma ugacomeka iyo module muburyo bukonje, bumaze gutozwa amashusho yo gukwirakwiza nka Stable Diffusion. Ishusho yerekana ishusho iracyakora isura, imiterere, nibirimo, mugihe module yimikorere yiga uburyo pigiseli igomba kugenda kandi ikaguma kumurongo. Icy'ingenzi, kubera ko icyitegererezo fatizo gikomeza gukonjeshwa, module imwe irashobora kumanikwa ku bihumbi n’ibihumbi byiza byabaturage hamwe na LoRAs, bityo umukoresha akamenyero anime, gufotora, cyangwa kugenzura amarangi atunguranye. Ibisubizo mubisanzwe ni clip ngufi ya 16 frame. Nyuma verisiyo yongeweho icyerekezo LoRAs kugirango igenzure kamera (pan, zoom, umuzingo) na SparseCtrl kugirango itondekanye kumurongo mike yo kuyobora.
Ubushishozi
Icyerekezo module yinjizwemo nkibitekerezo byigihe gito hagati yimiterere ihari ya U-Net. Mugihe cyo kwerekana, buri kintu gishobora kwitabira kurindi zina mugihe cyigihe, bityo isura cyangwa ikintu cyakozwe mugice cya 1 kiguma gihuje kumurongo 8. Gusa ibyo byiciro byigihe gito byatojwe kuri videwo; uburemere bwibibanza ntibukoraho, niyo mpamvu utabishaka neza-shusho yerekana ishusho ikomeza guhuzwa.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Ejo hazaza ha AnimateDiff Motion Generation
AnimateDiff yakemuye icyuho mbere yerekana amashusho yabigenewe, kandi filozofiya yayo icomeka ikomeza kugira uruhare mu murima. Tegereza icyerekezo cyimikorere kugirango ushyigikire amashusho maremare, imiterere ihanitse, hamwe na kamera ikarishye hamwe no kugenzura inzira, wongeyeho guhuza hamwe na ControlNet-yubuyobozi. Nka videwo nini ya videwo ikwirakwizwa hamwe na moderi yerekana amashusho akuze, imiterere ya adaptate ya AnimateDiff irashobora gukomeza kuba iyagaciro muguhindura bihendutse isomero rinini ryibikoresho byabigenewe byihariye, byerekana amashusho yerekana amashusho manini adasubiramo.
Gushyira mu bikorwa Isi
Kwerekana Anime-Imiterere yihariye ya Stable Diffusion igenzura mumashusho mugufi
Ongeraho kamera itinda zoom cyangwa isafuriya ahantu nyaburanga hakoreshejwe icyerekezo LoRA
Gukora uduce duto twa animasiyo cyangwa imbuga nkoranyambaga zivuye mu nyandiko imwe
Koresha SparseCtrl hamwe na couple ebyiri zingenzi kugirango uyobore inzibacyuho hagati yimyanya ibiri
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AnimateDiff Motion Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Lumiere Umwanya-Igihe Video Igisekuru
Ibibazo bikunze kubazwa
What is AnimateDiff Motion Generation?
AnimateDiff ni tekinike yongerera icyerekezo cyimyandikire-yerekana-ishusho yo gukwirakwiza nka Stable Diffusion, ihindura amashusho yerekana amashusho mo amashanyarazi magufi atarinze kongera kwerekana moderi yose. Nibyingenzi kuko ireka ecosystem nini ya moderi yerekana amashusho hamwe nuburyo bwihariye butanga animasiyo ihendutse.
Niki gitekerezo cyibanze inyuma ya AnimateDiff?
AnimateDiff yinjiza module yimyitozo itandukanye muburyo buriho, bwahagaritswe inyandiko-y-ishusho kuburyo ishobora kubyara icyerekezo itongeye imyitozo yibanze.
Kuki AnimateDiff ishobora gukorana na moderi nyinshi zakozwe nabaturage?
Kuberako uburemere (umwanya) uburemere budakorwaho, module yimodoka irashobora kumanikwa kubihumbi-byiza-tunone na LoRAs.
Nigute module yimikorere ituma amakadiri ahuza hamwe?
Icyitonderwa cyigihe gito cyongewe kuri U-Net reka buri kadamu yitabe kubandi mugihe cyigihe, ikomeza guhuza.
Nuwuhe muryango wintangarugero AnimateDiff ifitanye isano no kwaguka?
AnimateDiff yubatswe kugirango yongere icyerekezo kuri Stable Diffusion-yuburyo bwanditse-ku-shusho ikwirakwizwa.
Niki icyerekezo LoRA muri ecosystem ya AnimateDiff isanzwe igenzura?
Motion LoRAs yatangijwe kugirango yerekane kamera nka panne, zooming, hamwe no kuzunguruka.