Tune-A-Video Otu-mgbọ na-edezi
Tune-A-Video dị mma-na-akụ ụdị mgbasa ozi ederede-gaa na onyonyo a zụrụ azụ n'otu vidiyo ka ọ nwee ike degharịa obere vidiyo ahụ site na mkpali ederede ọhụrụ.
Nchịkọta
It matters because it showed you don't need massive video datasets to get text-driven video editing working.
Ime miri emi
Tune-A-Video, ewebata na mbubreyo 2022, na-akwado 'ọgbọ vidiyo otu-ise': ị na-enye ya otu vidiyo isi iyi gbakwunyere isiokwu, ọ na-amụtakwa nke ọma iji megharịa vidiyo ahụ n'okpuru mkpali ọhụrụ (na-agbanwe isiokwu, ụdị, ma ọ bụ àgwà) ka ị na-edebe mmegharị mbụ. Kama ịzụ ihe ngosi vidiyo site na ọkọ, ọ na-ebunye ihe nlere ederede gaa na onyonyo a zụrụ azụ (Stable Diffusion) n'ime ihe ngosi vidiyo pseudo site na ịgbatị mgbanwe 2D na nlebara anya n'ofe oge. Mgbe ahụ, ọ na-ada ụda naanị ntakịrị ihe na otu clip. N'ịtụle, ntụgharị DDIM nke okpokolo agba isi mmalite na-akwado nhazi ahụ ka ndezi ya na-adịru nwa oge kama ịmegharị fremu-to-frame.
Nghọta nka nka
Isi aghụghọ bụ 'nlegharị anya otu égbè' na nlebara anya na-adị obere oge. A na-emegharị nlebara anya onwe onye ihe onyonyo a ka etiti ọ bụla ga-aga na etiti nke mbụ na nke gara aga, na-agbasa ọdịdị yana na-eme ka njikọta ngagharị. Naanị matrices nlebara anya (na ọkwa oge) ka emelitere, na-edobe ngwa ngwa na ọnụ ala. Ntugharị DDIM na-atụgharị fremu isi iyi azụ ka ọ bụrụ mkpọtụ ka ọgbọ na-amalite site na nhazi-ichekwa latent kama mkpọtụ mkpọtụ.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke Tune-A-Video One-shot edezi
Tune-A-Video welitere ebili mmiri nke nlegharị anya na enweghị atụ (Video-P2P, FateZero, Text2Video-Zero, Pix2Video) nke na-ezere ọzụzụ otu-clip kpamkpam. Ihe a na-emekarị bụ iji dezie obere vidiyo aka ike ozugbo yana modul nwa oge siri ike yana ọkpụkpụ mgbasa mgbasa vidiyo nke obodo. Na-atụ anya ka otu mgbọ ga-abịaru nso dị ka ụdị vidiyo ntọala dị ka Sora sistemu ụdị na-eme ka ọ na-agbanwe agbanwe, na-eme ngwa ngwa na-edezi ikike arụnyere kama ịrụ ọrụ nke ọma.
Mmejuputa n'ezie n'ụwa
Na-atụgharị obere vidiyo nke 'nwoke na-egwu ski' ka ọ bụrụ 'Spider-Man ski' ka ọ na-echekwa ihe osise mbụ.
Ichekwa ezigbo vidiyo nkịta na-eje ije n'ime ihe nkiri Van Gogh ma ọ bụ mmiricolor
Ịgbanwe àgwà isiokwu, dị ka ịgbanwe panda na-eri achara ka ọ bụrụ koala na-eri achara.
Ngosipụta echiche dị mkpirikpi maka mgbasa ozi site na-edezi otu obere vidiyo nwere mkpali dị iche iche
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tune-A-Video One-Shot Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Mee-A-Video Ederede-na-Video
Ajụjụ a na-ajụkarị
What is Tune-A-Video One-Shot Editing?
Tune-A-Video dị mma-na-akụ ụdị mgbasa ozi ederede-gaa na onyonyo a zụrụ azụ n'otu vidiyo ka ọ nwee ike degharịa obere vidiyo ahụ site na mkpali ederede ọhụrụ. Ọ dị mkpa n'ihi na ọ gosipụtara na ịchọghị nnukwu dataset vidiyo iji nweta ndezi vidiyo na-akpali ederede na-arụ ọrụ.
Kedu ụdị ntọala Tune-A-Video na-amalite tupu ịmegharị ya maka vidiyo?
Tune-A-Video 'na-ewelite' ụdị mgbasa ozi ederede-gaa na onyonyo a zụrụ azụ ka ọ bụrụ ihe ngosi vidiyo pseudo karịa ọzụzụ na nnukwu vidiyo vidiyo.
Kedu ihe 'otu-shot' na-ezo aka na Tune-A-Video?
Otu-shot pụtara na a na-emegharị ihe nlere anya nke ọma na otu vidiyo ntinye gbakwunyere isiokwu ya tupu a chọgharịa ya ka ọ dezie ya.
Kedu ka Tune-A-Video si edobe okpokolo agba edezi ka ọ na-adịru nwa oge?
Nleba anya n'okirikiri (sparse spatio-temporal) na-eme ka etiti ọ bụla lelee okpokolo agba nke mbụ na nke gara aga, na-agbasa ọdịdị na ngagharị.
Kedu ọrụ ntụgharị DDIM na-arụ n'oge ntụgharị?
Mgbanwe DDIM na-esetịpụ ezigbo okpokolo agba azụ na mkpọtụ, yabụ ọgbọ na-amalite site na latent nke na-echekwa nhazi na ngagharị mbụ.
N'oge a na-emegharị ya, kedu ihe Tune-A-Video na-emelite ka ọ nọgide na-arụ ọrụ nke ọma?
Ọ na-edobe obere mpaghara nwere oke, ọkachasị nlebara anya nlebara anya na ọkwa oge, na-eme ka usoro ahụ dị obere.