AnimateDiff Motion Generation
AnimateDiff wata dabara ce da ke ƙara motsi zuwa samfuran watsa rubutu-zuwa-hoto da ke wanzu kamar Stable Diffusion, juya masu samar da hoto zuwa gajeriyar injin bidiyo ba tare da sake horar da ƙirar gabaɗayan ba.
Dubawa
It matters because it lets the huge ecosystem of image models and custom styles produce animation cheaply.
Zurfafa nutsewa
AnimateDiff yana aiki ta hanyar horar da keɓantaccen tsarin 'motsi' akan shirye-shiryen bidiyo sannan toshe wannan module ɗin cikin daskararre, samfurin watsa hoto wanda aka rigaya ya horar da shi kamar Stable Diffusion. Samfurin hoton har yanzu yana sarrafa bayyanar, salo, da abun ciki, yayin da tsarin motsi ke koyon yadda pixels zasu motsa kuma su kasance masu daidaito a cikin firam. Mahimmanci, saboda ƙirar tushe ta tsaya a daskare, za'a iya jefar da tsarin motsi iri ɗaya akan dubunnan kyawawan waƙoƙin al'umma da LoRAs, don haka anime na al'ada na mai amfani, hoto na hoto, ko wurin binciken zane ba zato ba tsammani. Sakamakon yawanci ɗan gajeren shirin ne mai kusan firam 16. Siffar daga baya sun ƙara motsi LoRAs don sarrafa motsin kyamara (kwal, zuƙowa, yi) da SparseCtrl don daidaitawa akan ƴan firam ɗin jagora.
Fahimtar Fasaha
An shigar da tsarin motsi azaman matakan kulawa na ɗan lokaci tsakanin yadudduka na sararin samaniya na U-Net. A lokacin denoising, kowane firam na iya halartar sauran firam tare da wani lokaci axis, don haka fuska ko abu da aka samar a cikin firam 1 ya kasance daidai a cikin firam 8. Waɗannan yadudduka na ɗan lokaci ne kawai aka horar da su akan bidiyo; Ba a taɓa ma'aunin sararin samaniya ba, wanda shine dalilin da ya sa ƙirar hotuna masu kyau da aka daidaita suka kasance masu jituwa.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar AnimateDiff Motion Generation
AnimateDiff ya cike gibin kafin ƙirar bidiyo da aka keɓe, kuma falsafar filogin sa tana ci gaba da yin tasiri a filin. Yi tsammanin nau'ikan motsi don tallafawa shirye-shiryen bidiyo masu tsayi, ƙuduri mafi girma, da ƙarar kamara da sarrafa yanayi, da haɗin kai tare da jagorar salon ControlNet. Kamar yadda manyan watsa shirye-shiryen bidiyo na asali da samfuran bidiyo masu canzawa suka girma, masu adaftan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan bidiyo ba sa kwafi na asali.
Aiwatar da Gaskiyar Duniya
Nuna wurin bincike na Stable Diffusion na al'ada na al'ada a cikin ɗan gajeren shirin sifofi
Ƙara jinkirin zuƙowa kamara ko kwanon rufi zuwa shimfidar wuri da aka ƙirƙira ta amfani da motsi LoRA
Ƙirƙirar gajerun lambobi masu rai ko madaukai na kafofin watsa labarun daga saƙon rubutu guda ɗaya
Amfani da SparseCtrl tare da maɓallan maɓalli guda biyu don jagorantar sauyi tsakanin fage biyu
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AnimateDiff Motion Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Lumiere Space-Time Bidiyo Generation
Tambayoyin da ake yawan yi
What is AnimateDiff Motion Generation?
AnimateDiff wata dabara ce da ke ƙara motsi zuwa samfuran watsa rubutu-zuwa-hoto da ke wanzu kamar Stable Diffusion, juya masu samar da hoto zuwa gajeriyar injin bidiyo ba tare da sake horar da ƙirar gabaɗayan ba. Yana da mahimmanci saboda yana ƙyale ɗimbin yanayin yanayin ƙirar hoto da salon al'ada su samar da rayarwa cikin arha.
Menene ainihin ra'ayin da ke bayan AnimateDiff?
AnimateDiff yana shigar da keɓantaccen tsarin motsi na horarwa a cikin samfurin rubutu da aka daskare don haka zai iya haifar da motsi ba tare da sake horar da ƙirar tushe ba.
Me yasa AnimateDiff zai iya aiki tare da samfuran hoto da yawa na al'umma?
Saboda ba a taɓa ma'aunin bayyanar (tsarin sarari) ba, za'a iya jefar da tsarin motsi a kan dubban kyawawan-tunani da LoRAs.
Ta yaya tsarin motsi ke kiyaye firam ɗin daidai da juna?
Yaduddukan kulawa na ɗan lokaci da aka ƙara zuwa U-Net ya bar kowane firam ɗin ya halarci sauran tare da kullin lokaci, yana kiyaye daidaituwa.
Wane dangi ne AnimateDiff ya fi alaƙa da haɓakawa?
An gina AnimateDiff don ƙara motsi zuwa Stable Diffusion-style rubutu-zuwa-hoto yatsa samfurin.
Menene motsi LoRA a cikin yanayin yanayin AnimateDiff yawanci ke sarrafawa?
Motion LoRAs an gabatar da su don tafiyar da motsin kyamara kamar kunna, zuƙowa, da mirgina.