Diffusion wideo bu dëgër
Diffusion wideo bu dëgër (SVD) mooy xeetu fondasioŋ ubbeeku bu Stability AI buy soppi benn nataal bu taxaw nekk benn wideo bu gàtt buy daw bu baax.
Résumé
It matters because it brought capable, openly available image-to-video generation to researchers and creators instead of locking it behind closed APIs.
Plongeur bu xóot
Stability AI moo ko genne ci atum 2023, diffusion wideo bu dëgër dafay yaatal architecture diffusion bu dëgër bi lalu ci nataal ci wàllu waxtu. Dafay tàmbalee ci xeetu nataal buñ tàggat bu njëkk, ba noppi dugal ci ay layer temporel yuy jàng ni pixel yi wara jëm kanam ci kaadar bu nekk, suko defee yëngu bi nekk ci anam wu wuute te baña flicker. Ekip bi dafa fësal rëset bu am ñatti pàcc: njëkka tàggat nataal, ginaaw ga tàggat wideo ci kaw benn done wideo bu yaatu, ginaaw ga finetuning bu baax ci benn set bu gëna ndaw buñ polise. Checkpoint publik yi defar nañu lu tollu ci 14 ba 25 kadre. Ndax dañu génne poid yi ci lu leer, SVD nekkoon launchpad ngir askan wi tabax ay doxalinu kamera-mouvement, clips yu gëna gudd, ak variants yu finetuned, gaawal gëstu defar wideo ubbeeku.
Gis-gis xarala
SVD xeetu diffusion bu nëbbu la: dafay dindi bruit ci barab bu nëbbu buñ komprime, du ci pixel yu ñor, te loolu dafay sakkanal ordinatër bu bari. Li gëna am solo ci modelu nataal bu taxaw mooy bàyyi xel ci diir bi ak ay couche convolution 3D yuy boole kadre yi, kon reso bi dafay xalaat ci yëngu ci clip bi yépp benn yoon. Dafay aju ci nataal buñ dugal, te anam wi ñuy dindi bruit bi dafay soppi bruit bu bari bi ci ay kadre yu boole, yu ñépp déggoo ci mbir yi, leeraay bi ak yëngu gi.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu diffusion wideo bu dëgër
SVD's njeexte lu yàgg mooy nekk base bu ubbeeku ñeneen ñi yokk ludul nekk state-of-the-art guddaay wala njiit fidélité. Sistem yu bees yu tëju yi defar nañu clip yu gëna gudd, gëna ñaw, ak son sync, waaye lignée SVD bu ubbeeku bi dafay wéy di dooleel jumtukaayi askan wi, finetunes, ak workflows kamera yuñ mëna saytu. Xaarandi xeetu wideo yu ubbeeku ngir wéy di topp diir bu gëna gudd, realisme physique bu gëna baax, ak jëfandikukat bu gëna dëgër di doxal mouvement ak framing, ak curation done ak consistance temporel des ci centre battlegrounds technique.
Doxal ci àdduna dëgg
Animasioŋ ab produit ci orbite bu yeex wala nataal buy zoom ngir benn butig ci net bi
Dundal ab kadre konsept-art ak yëngu yu woyof ngir filmu pitch wala mood reel
Defar ay clip ci ginaaw ngir sitweb yi ak reso sosio yi ci benn nataal
Defar seen yu gàtt yu lalu ci nataal ngir widewo misik wala jàngat art
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Stable Video Diffusion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Stable Diffusion
Laaj yi ñuy faral di laaj
What is Stable Video Diffusion?
Diffusion wideo bu dëgër (SVD) mooy xeetu fondasioŋ ubbeeku bu Stability AI buy soppi benn nataal bu taxaw nekk benn wideo bu gàtt buy daw bu baax. Dafa am solo ndax indi na ay nataal-ci-wideo yu mëna am, yu ubbeeku ci gëstukat yi ak defarkat yi, duñu ko tëj ci ginnàaw API yu tëju.
Lan mooy dugal bu njëkk bi diffusion wideo stabil di jëfandikoo ngir defar clip?
SVD ci yoon sax xeetu nataal la ci wideo: dafay jël benn nataal bu taxaw ba noppi defar ci yëngu.
Lan la SVD yokk ci architecture diffusion bu dëgër ngir mëna yëngu?
SVD dafay dugal ay bàyyi xel ci diir bu gàtt ak ay couche convolution 3D suko defee kadre yi di wéy di méngoo ci diir bi yépp.
Diffusion wideo stabil def denoising ci ban xeetu espace ngir sakkanal ordinatër?
SVD melni diffusion bu dëgër, xeetu diffusion bu nëbbu la buy dox ci gis-gis bu nëbbu buñ komprime, di wàññi bu baax xayma yi.
Lan moo waral génnug SVD am solo ci askanu IA yi?
Poid yu ubbeeku yi dañuy may gëstukat yi ak defarkat yi ñu yokk SVD ci doxalinu kamera, finetunes, ak jàngat clip yu gëna gudd.
Lu tollu ci ñaata kadre la checkpoint publik yu SVD di defar?
SVD checkpoint yiñ génne dañuy defar ay clip yu gàtt yu tollu ci 14 ba 25 kadre.