Tune-A-Video Gyaran Harbi Daya
Tune-A-Video yana da kyau-saukar da tsarin watsa shirye-shiryen rubutu-zuwa-hoto da aka riga aka yi akan bidiyo guda don ya iya sake gyara wancan shirin daga sabon saƙon rubutu.
Dubawa
It matters because it showed you don't need massive video datasets to get text-driven video editing working.
Zurfafa nutsewa
Tune-A-Video, wanda aka gabatar a ƙarshen 2022, yana magance 'ƙarni na bidiyo mai harbi ɗaya': kuna ba shi bidiyo mai tushe guda ɗaya tare da taken magana, kuma yana koyan isa kawai don sake haɓaka wancan bidiyon a ƙarƙashin sabon faɗakarwa (canza wani batu, salo, ko sifa) yayin kiyaye motsi na asali. Maimakon horar da samfurin bidiyo daga karce, yana ƙaddamar da ƙirar rubutu-zuwa-hoto da aka riga aka horar (Stable Diffusion) zuwa ƙirar bidiyo mai ƙima ta hanyar ƙaddamar da jujjuyawar 2D da hankali a duk tsawon lokaci. Daga nan sai ya yi kyau-sauƙaƙƙiya kaɗan kawai na sigogi akan shirin guda ɗaya. Dangane da ra'ayi, jujjuyawar DDIM na firam ɗin tushen yana ƙulla tsarin don haka gyare-gyaren ya tsaya na ɗan lokaci maimakon firam-zuwa-firam.
Fahimtar Fasaha
Makullin dabarar ita ce 'ɗaukar hoto-ɗaya' tare da ƙarancin hankali-lokaci-lokaci. An sake mayar da hankalin ƙirar ƙirar don haka kowane firam ɗin yana halartar firam na farko da firam ɗin da ya gabata, yana yaɗa bayyanar da tilasta daidaituwar motsi. Matrices tsinkayar hankali ne kawai aka sabunta (da yadudduka na ɗan lokaci), ana yin sa cikin sauri da arha. Juyawar DDIM tana juyar da firam ɗin tushe zuwa amo don haka tsara ta fara daga tsarin tsare-tsare maimakon hayaniyar bazuwar.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar Tune-A-Video One-Shot Editing
Tune-A-Video ya haifar da raƙuman kunnawa mara kyau da masu maye gurbin harbi (Video-P2P, FateZero, Text2Video-Zero, Pix2Video) waɗanda ke guje wa horon kowane-clip gaba ɗaya. Halin yana zuwa ga shirya shirye-shiryen bidiyo na sabani nan take tare da ingantattun na'urori na ɗan lokaci da ƙashin baya na watsa bidiyo na asali. Yi tsammanin hanyoyin da za su shuɗe kamar yadda tsarin bidiyo na tushe kamar Sora-tsaru-tsaru masu daidaitawa, saurin aiwatar da iyawar ginanniyar aiki maimakon aiki mai kyau.
Aiwatar da Gaskiyar Duniya
Juya faifan bidiyo na 'mutumin kankara' zuwa 'Spider-Man Skiing' yayin da ake adana motsin sassaƙa na asali.
Sake salo na ainihin bidiyo na karen tafiya zuwa cikin Van Gogh ko kallon mai raɗaɗi na ruwa
Canza halayen wani batu, kamar canza panda mai cin bamboo zuwa koala mai cin gora.
Samar da gajeriyar ra'ayi don tallace-tallace ta hanyar shirya shirin tunani guda ɗaya tare da tsokana iri-iri
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tune-A-Video One-Shot Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Yi-A-Video Rubutu-zuwa-Bidiyo
Tambayoyin da ake yawan yi
What is Tune-A-Video One-Shot Editing?
Tune-A-Video yana da kyau-saukar da tsarin watsa shirye-shiryen rubutu-zuwa-hoto da aka riga aka yi akan bidiyo guda don ya iya sake gyara wancan shirin daga sabon saƙon rubutu. Yana da mahimmanci saboda ya nuna ba kwa buƙatar manyan bayanan bidiyo don samun aikin gyaran bidiyo da aka kora da rubutu.
Wane samfurin tushe Tune-A-Video ya fara daga kafin daidaita shi don bidiyo?
Tune-A-Video yana 'ƙasa' samfurin watsa shirye-shiryen rubutu-zuwa-hoto da aka riga aka horar zuwa cikin ƙirar-bidiyo na ƙarya maimakon horarwa kan babbar ƙungiyar bidiyo.
Menene 'harbi ɗaya' ke nufi a Tune-A-Video?
Harbi ɗaya yana nufin samfurin yana da kyau a daidaita shi akan bidiyon shigarwa guda ɗaya tare da taken sa kafin a sake neman gyara.
Ta yaya Tune-A-Video ke kiyaye firam ɗin da aka gyara na ɗan lokaci?
Tsare-tsare (sparse spatio-temporal) hankali yana bawa kowane firam damar duba firam na farko da na baya, yaɗa bayyanar da motsi.
Wace rawa juyar da DDIM ke takawa a lokacin ƙaddamarwa?
Juyawa DDIM taswirar ainihin firam ɗin baya zuwa amo, don haka tsara yana farawa daga latent wanda ke adana ainihin tsari da motsi.
Lokacin kunnawa, menene Tune-A-Video ke ɗauka da farko don kasancewa mai inganci?
Yana daidaita ƙayyadaddun ƙayyadaddun yanki, galibi tsinkayen hankali da yadudduka na ɗan lokaci, yana kiyaye tsarin mara nauyi.