Tune-A-Wideo
Tune-A-Video dafay gëna defar xeetu diffusion bind-ci-nataal buñ tàggat bu njëkk ci benn wideo suko defee mu mëna soppaliwaat clip bi ci laaj bind bu bees.
Résumé
It matters because it showed you don't need massive video datasets to get text-driven video editing working.
Plongeur bu xóot
Tune-A-Video, bi ñu dugal ci 2022, dafay wax ci 'generation wideo bu benn yoon': nga jox ko benn wideo source ak benn caption, mu jàng lu doy ngir defaraat wideo boobu ci ay laaj yu bees (soppi sujet, stil, wala màndarga) boole ci tëye mouvement original bi. Du tàggat benn xeetu wideo ci noonu, waaye dafay gëna yokk benn xeetu bind-ci-nataal (Diffusion Stable) ci xeetu pseudo-wideo ci yokk convolutions 2D ak bàyyi xel ci axis temps bi. Ginaaw loolu mu defar ay parametre yu ndaw ci benn clip bi. Ci tënk, DDIM inversion ci kadre source yi dafay ancre structure bi suko defee coppite yi di des ci diir bu gàtt ludul flickering kadre-ci-kadre.
Gis-gis xarala
Li gëna am solo mooy 'akordeer benn yoon' ak bàyyi xel ci wàllu spatio-temporal bu néew. Modèlu nataal bi dafay bàyyi xel ci boppam, suko defee kadre bu nekk di bàyyi xel ci kadre bi njëkk ak kadre bi ko jiitu, di tasaare melokaan bi, di fexe ba tànki yëngu yi méngoo. Duñuy yeesal matrisi projection attention yi (ak couche temporale yi), suko defee tuning bi gaaw te yomb. DDIM inversion dafay soppi kadre source yi dellu ci bruit suko defee generation bi tàmbali ci ab latent buy baña yàq structure bi moo gën ab bruit bu bari.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Tune-A-Video ci benn yoon
Tune-A-Video dafa jur ay xeetu wideo yu bari yu amul benn tuning (wideo-P2P, FateZero, Text2Wideo-Zero, Pix2Wideo) yu moytu tàggat clip bu nekk. Tendens bi mooy soppali clip yu bari ci saasi ak module temporal yu gëna am doole ak yaxu ndigg ngir diffusion wideo. Xaarandil ni jegewaale yu benn yoon yi dina ñu ni mes ndax xeetu wideo yu melni Sora-style sistem yi dañuy def soppali bu dëppoo ak gaaw, muy luñu tabax ci biir, du liggéey bu jaar yoon.
Doxal ci àdduna dëgg
Soppi benn clip bu 'ku nekk ci ski' mu nekk 'Spider-Man buy ski' boole ci denc mouvement tablo bu njëkk bi
Defar wideo xaj buy dox dëgg def ko Van Gogh wala look animation aquarelle
Weccoo màndarga sujet, lu melni soppi panda buy lekk bamboo mu nekk koala buy lekk bamboo
Prototyping konsept animaasioŋ yu gàtt ngir yëgle ci soppali benn clip royuwaay ak ay laaj yu bari
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tune-A-Video One-Shot Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Defar-A-Wideo Bind-ci-Wideo
Laaj yi ñuy faral di laaj
What is Tune-A-Video One-Shot Editing?
Tune-A-Video dafay gëna defar xeetu diffusion bind-ci-nataal buñ tàggat bu njëkk ci benn wideo suko defee mu mëna soppaliwaat clip bi ci laaj bind bu bees. Dafa am solo ndax dafa wane ni soxlawolen ay done wideo yu bari ngir mëna soppali wideo yu bind.
Ban model la Tune-A-Video di tàmbalee balaa ñu koy méngale ak wideo?
Tune-A-Video dafay 'gëna' xeetu diffusion bind-ci-nataal buñ tàggat bu njëkk ci xeetu pseudo-wideo, du tàggat ci corpus wideo yu mag.
Luy 'benn yoon' ci Tune-A-Video?
Benn-shot dafay tekki ni dañu defar model bi bu baax ci benn wideo buñ dugal boole ci kapsiyon bi balaa ñu koy laaj ñu soppali ko.
Naka la Tune-A-Video di def ba kadre yiñ soppali nekk ci diir bu gàtt?
Foofu kadre bu jaar (espace-temporal bu néew) dafay tax kadre bu nekk xool kadre bu njëkk bi ak bi ko jiitu, di tasaare melokaan ak yëngu.
Ban cër la DDIM inversion def ci waxtu inference?
DDIM inversion dafay delloosi kadre yi ci bruit, kon defar bi dafay tàmbali ci lu nëbbu luy tëye structure ak mouvement bi njëkk.
Sooy tuning, lan la Tune-A-Video di njëkka yeesal ngir mëna wéy di dox?
Dafay raññe ay subset yu ndaw, rawatina ay projection ak ay couche temporale, suko defee procédure bi gëna woyof.