AnimateDiff Motion Generation
AnimateDiff waa farsamo ku kordhinaysa dhaq-dhaqaaqa moodooyinka fidinta qoraalka-ilaa-sawir ee jira sida Stable Diffusion, u roga soo-saareyaasha sawirka weli-gaaban ee soo-saareyaasha fiidyowga iyada oo aan dib loo tababarin qaabka oo dhan.
Dulmar
It matters because it lets the huge ecosystem of image models and custom styles produce animation cheaply.
quusid qoto dheer
AnimateDiff wuxuu u shaqeeyaa isagoo tababaraya 'module mooshin' gooni ah oo fiidiyoowyo ah ka dibna ku dhejinaya cutubkaas qaab barafaysan, oo horay loo tababaray qaabka fidinta sawirka sida Stable Diffusion. Qaabka sawirka ayaa wali gacanta ku haya muuqaalka, qaabka, iyo waxa ku jira, halka moduleka dhaqdhaqaaqu uu baranayo sida pixels u dhaqaaqi karo oo ay si joogto ah u joogaan guud ahaan xayndaabyada. Muhiimad ahaan, sababta oo ah moodelka salku wuu barafoobay, isla moduleka dhaqdhaqaaqa ayaa lagu ridi karaa kumanaan heeso-laxan oo bulshada ah iyo LoRAs, sidaa darteed anime-ga caadiga ah ee isticmaalaha, sawir-qaadaha, ama isbaarada rinjiga ayaa si lama filaan ah u nool. Natiijadu waxay caadi ahaan tahay clip gaaban oo ku dhawaad 16 fareemay ah. Noocyadii dambe waxay ku darsadeen dhaqdhaqaaq LoRAs si loo xakameeyo dhaqaaqa kamarada ( digsiga, zoom, duub) iyo SparseCtrl si loogu qaboojiyo dhawr qaybood oo hagitaan ah.
Aragtida Farsamada
Qaabka dhaqdhaqaaqa waxa loo geliyey lakabyo feejignaan ku meel gaar ah oo u dhexeeya lakabyada bannaan ee U-Net. Inta lagu guda jiro diidmada, jir kastaa wuxuu la xiriiri karaa xayndaabyada kale iyada oo la raacayo dhidibka wakhtiga, markaa wejiga ama shay ka soo baxay shaxanka 1 wuxuu ahaanayaa mid isku xiran oo dhex yaal 8. Lakabyadan ku meel gaarka ah oo keliya ayaa lagu tababaray fiidyowga; Miisaanka goobuhu lama taaban, taas oo ah sababta moodooyinka sawir-qaadaha ee si fiican loo hagaajiyay ay weli iswaafaqayaan.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Visual AI wuxuu si otomaatig ah u samayn karaa baadhista, ogaanshaha, iyo sumadaynta hawlaha miisaanka.
Xulashada dhismayaasha
Kooxaha hal-abuurka leh waxay hindise karaan fikradaha si dhakhso leh iyagoo leh dib-u-eegis buugeed yar.
Kooxda iyo socodka shaqada
Hawlgalladu waxay isticmaali karaan calaamadaha muuqaalka iyo muuqaalka kuwaas oo markii hore adkeyd in la farsameeyo.
Mustaqbalka Jiilka Dhaqdhaqaaqa AnimateDiff
AnimateDiff waxay soo xidhay farqiga ka hor moodooyinka fiidyaha ee go'an, iyo falsafadeeda fur-ku-gudbinta waxay sii wadaysaa inay saameyn ku yeelato goobta. Filo qaybaha dhaqdhaqaaqa si ay u taageeraan clips dheer, xallinta sare, iyo kamarad adag iyo kontoroolka jihada, oo lagu daray is dhexgalka hagida qaabka ControlNet. Maaddaama fiidiyaha fiidiyaha ee ballaaran iyo moodooyinka fiidiyaha ee isbeddelka ay qaangaareen, Adabiyeyaasha-qaabka AnimateDiff waxay u badan tahay inay qiimo u lahaan doonaan si raqiis ah u dhaq-dhaqaaqa maktabadda ballaaran ee gaarka ah, isbaarooyinka sawirka qaabaysan ee moodooyinka fiidiyaha waaweyn aysan si asal ah u soo celin.
Dhaqangelinta Adduunka-dhabta ah
Abuuritaanka barta koontarool ee fidinta degenaansho ee qaabka anime-ga oo loo geliyo goos goos gaaban oo jilaa ah
Ku-daridda soo-dhoweynta kamarada tartiib-tartiib ah ama digsi muuqaal la sameeyay iyadoo la adeegsanayo dhaqdhaqaaqa LoRA
Abuuritaanka istiikaro firfircoon oo kooban ama wareegyada warbaahinta bulshada ee hal qoraal oo degdeg ah
Isticmaalka SparseCtrl oo wata dhawr furayaal si ay u hagto kala-guurka labada muuqaal
Khatarta & Dariiqyada Ilaalada
Xuquuqda sawirka iyo ogolaanshaha waxay noqon kartaa khataro sharci ah haddii caddayntu aanay caddayn.
Waxqabadka moodeelku wuu ku kala duwanaan karaa iftiinka, tirakoobka, iyo deegaanka.
Wanaagga beenta ah waxa laga yaabaa inaan la dareemin ilaa xadka kalsoonida aan la kormeerin.
Qorshe Hawleedka Dhaqangelinta
Qeex shuruudaha aqbalida ee saxnaanta, dib u celinta, iyo kharashyada khaladka.
Ku tijaabi xogta ku habboon xaaladaha wax soo saarka dhabta ah.
Ku dar dib u eegis bini'aadamka si aad u hesho kalsoonida hoose ama saameeynta sare.
Lasoco moodeel dhaqaaqa oo dib u cusboonaysii kamarada ama xogta kaydinta ka dib.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AnimateDiff Motion Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Lumiere Space-Waqtiga Fiidiyowga
Su'aalaha soo noqnoqda
What is AnimateDiff Motion Generation?
AnimateDiff waa farsamo ku kordhinaysa dhaq-dhaqaaqa moodooyinka fidinta qoraalka-ilaa-sawir ee jira sida Stable Diffusion, u roga soo-saareyaasha sawirka weli-gaaban ee soo-saareyaasha fiidyowga iyada oo aan dib loo tababarin qaabka oo dhan. Waa arrin sababtoo ah waxay u ogolaataa nidaamka deegaanka weyn ee moodooyinka sawirka iyo qaababka caadiga ah inay soo saaraan animation si jaban.
Waa maxay fikradda asaasiga ah ee ka dambeysa AnimateDiff?
AnimateDiff waxa ay gelisaa cutub dhaqaaq oo si gaar ah loo tababaray geliyey qaab jira, barafaysan qoraal-ilaa-sawir si ay u soo saarto dhaqdhaqaaq iyada oo aan dib loo tababarin qaabka saldhiga.
Maxay AnimateDiff ula shaqayn kartaa qaabab badan oo muuqaal ah oo bulshadu samaysay?
Sababtoo ah miisaanka muuqaalka (meel bannaan) lama taaban, moduleka dhaqdhaqaaqa waxaa lagu tuuri karaa kumanaan-tune iyo LoRAs.
Sidee buu moobilka mooshinku u dhawraa xidhmooyin isku mid ah?
Lakabyada dareenka ku meel gaadhka ah ee lagu daray U-Net ha u ogolaado jir kasta inuu ka soo qayb galo kuwa kale iyadoo la raacayo dhidibka wakhtiga, ilaalinta isku xidhnaanta.
Qoyska noocee ah ayaa AnimateDiff inta badan xiriir la leh fidinta?
AnimateDiff waxaa loo dhisay in lagu daro dhaqdhaqaaqa qaabka Faafinta Stable Diffusion-qaabka qoraalka-ilaa-sawirka moodooyinka faafinta.
Waa maxay dhaqdhaqaaqa LoRA ee nidaamka deegaanka AnimateDiff sida caadiga ah?
Motion LoRAs waxaa loo soo bandhigay in ay hagaan dhaqdhaqaaqyada kamaradaha sida foorarsiga, zoomaynta, iyo rogrogga.