Ọgbọ Motion AnimateDiff
AnimateDiff bụ usoro na-agbakwunye mmegharị na ụdị mgbasa ozi ederede gaa na onyonyo dị ka Stable Diffusion, na-atụgharị ndị na-emepụta ihe onyonyo ka ọ bụrụ ndị na-emepụta vidiyo dị mkpụmkpụ na-azụghachighị ụdị ahụ niile.
Nchịkọta
It matters because it lets the huge ecosystem of image models and custom styles produce animation cheaply.
Ime miri emi
AnimateDiff na-arụ ọrụ site n'ịzụ 'modul ngagharị' dị iche na obere vidiyo wee tinye modul ahụ n'ime ụdị mgbasa ozi a zụrụ azụ, dị ka Stable Diffusion. Ụdị onyonyo a ka na-ejikwa ọdịdị, ụdị, na ọdịnaya, ebe modul ngagharị na-amụta ka pikselụ kwesịrị ịgagharị ma nọgide na-agbanwe agbanwe n'ofe okpokolo agba. N'ụzọ dị mkpa, n'ihi na ihe nlereanya ntọala ahụ na-ajụ oyi, otu modul ngagharị ahụ nwere ike ịdaba na puku kwuru puku egwu obodo yana LoRAs, yabụ ihe ngosi ọdịnala nke onye ọrụ, fotoreal, ma ọ bụ ihe osise na-eme na mberede. Nsonaazụ a na-abụkarị obere mkpirisi nke gburugburu okpokolo agba iri na isii. Ụdị ndị ọzọ agbakwunyere ngagharị LoRA iji jikwaa mmegharị igwefoto (pan, mbugharị, mpịakọta) na SparseCtrl maka nhazi na okpokolo agba ntụzịaka ole na ole.
Nghọta nka nka
A na-etinye modul ngagharị dị ka nlebara anya nwa oge n'etiti oghere oghere nke U-Net. N'oge a na-ekwu okwu, etiti ọ bụla nwere ike ịga na okpokolo agba nke ọzọ n'otu oge, ya mere ihu ma ọ bụ ihe emepụtara na etiti 1 na-anọkọ ọnụ na etiti 8. Naanị akwa oge a ka a zụrụ na vidiyo; A na-emetụghị ihe dị n'ime oghere ahụ aka, nke mere na ụdị onyonyo a na-emegharị nke ọma na-anọgide na-adakọ ọnụ.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke Ọgbọ Motion AnimateDiff
AnimateDiff kpuchiri oghere ahụ tupu ụdị vidiyo raara onwe ya nye, na nkà ihe ọmụma nkwụnye ya na-anọgide na-emetụta ubi ahụ. Na-atụ anya modul ngagharị iji kwado mkpachị dị ogologo, mkpebi dị elu, yana igwefoto siri ike na njikwa trajectory, gbakwunyere njikọta na ntuziaka ụdị ControlNet. Dị ka nnukwu mgbasa ozi vidiyo nke ala na ụdị vidiyo na-agbanwe agbanwe, ihe nkwụnye ụdị ụdị AnimateDiff ga-abụ ihe bara uru maka ịmegharị nnukwu ọbá akwụkwọ nke ọpụrụiche, ihe nleba anya onyonyo nke nnukwu ụdị vidiyo anaghị emepụtaghachi nke ọma.
Mmejuputa n'ezie n'ụwa
Na-ewelite ebe nlele Stable Diffusion ụdị anime n'ime obere mkpirisi agwa looping
Na-agbakwụnye mbugharị igwefoto nwayọ ma ọ bụ pan na odida obodo emepụtara site na iji ngagharị LoRA
Ịmepụta mpempe akwụkwọ mmado dị nkenke ma ọ bụ loops mgbasa ozi ọha site na otu ngwa ngwa ederede
Iji SparseCtrl nwere igodo igodo ole na ole iji duzie mgbanwe n'etiti ihe nkiri abụọ
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AnimateDiff Motion Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ọgbọ vidiyo Oge Oghere Lumiere
Ajụjụ a na-ajụkarị
What is AnimateDiff Motion Generation?
AnimateDiff bụ usoro na-agbakwunye mmegharị na ụdị mgbasa ozi ederede gaa na onyonyo dị ka Stable Diffusion, na-atụgharị ndị na-emepụta ihe onyonyo ka ọ bụrụ ndị na-emepụta vidiyo dị mkpụmkpụ na-azụghachighị ụdị ahụ niile. Ọ dị mkpa n'ihi na ọ na-ahapụ nnukwu gburugburu ebe obibi nke ụdị onyonyo na ụdị omenala na-emepụta animation ọnụ ala.
Kedu ihe bụ isi echiche dị n'azụ AnimateDiff?
AnimateDiff na-etinye modul ngagharị a zụrụ azụ iche n'ime ihe dị adị, oyi kpọnwụrụ ederede-ihe oyiyi ka ọ nwee ike iwepụta ngagharị na-azụghachighị ụdị ntọala ahụ.
Kedu ihe kpatara AnimateDiff nwere ike iji ọtụtụ ụdị onyonyo emere obodo?
N'ihi na emetụghị ihe dị n'ụdị (spatial), modul ngagharị nwere ike ịdaba na puku kwuru puku egwu na LoRA.
Kedu ka modul ngagharị si eme ka okpokolo agba na-adakọ n'otu n'otu?
Nlebara anya nwa oge agbakwunyere na U-Net ka etiti nke ọ bụla gakwuru ndị ọzọ n'otu oge, na-echekwa ịdị n'otu.
Kedu ezinụlọ ụdị AnimateDiff kacha jikọtara ya na ịgbatị?
Ewubere AnimateDiff iji gbakwunye ngagharị na ụdị mgbasa ozi Stable Diffusion ụdị ederede gaa na onyonyo.
Kedu ihe ngagharị LoRA na gburugburu gburugburu AnimateDiff na-achịkwa?
E webatara Motion LoRA ka ọ na-eduzi mmegharị igwefoto dị ka ịmegharị, mbugharị, na ntụgharị.