Lumiere Space-Time Bidiyo Generation
Lumiere samfurin watsa rubutu-zuwa-bidiyo ne daga Google Bincike wanda ke samar da cikakken shirin bidiyo lokaci guda ta amfani da Space-Time U-Net.
Dubawa
It matters because it tackles temporal consistency at the architecture level, producing smoother, more coherent motion than pipelines that stitch keyframes together.
Zurfafa nutsewa
An ƙaddamar da shi a farkon 2024, Lumiere ya ƙalubalanci ƙirar 'maɓalli na gama gari sannan a cika' ƙirar da yawancin injinan bidiyo ke amfani da su. Waɗancan hanyoyin ɓarke na farko suna haifar da ƴan maɓalli masu nisa sannan su haɗa juna, wanda zai iya haifar da motsin rai ko rashin daidaituwa saboda babu wata hanyar sadarwa guda ɗaya da ta taɓa ganin cikakken lokaci. A maimakon haka Lumiere yana haifar da duk tsawon ɗan lokaci na shirin a cikin wucewa ɗaya tare da Space-Time U-Net (STUNet). Cibiyar sadarwa tana raguwa a cikin sararin samaniya da lokaci, tana sarrafa taƙaitaccen wakilci na duka bidiyon tare don haka motsi ya daidaita a duniya. Wannan ƙira kuma tana ba da damar ayyuka daban-daban na gyare-gyare kamar hoto-zuwa-bidiyo, zane-zane, tsararrun tsararraki, da 'cinemagraphs' waɗanda ke ɗaukan zaɓin yanki ne kawai.
Fahimtar Fasaha
Babban ra'ayin shine Space-Time U-Net. Madaidaicin hoto na U-Net na ƙasa da samfura cikin faɗi da tsayi; STUNet yana ƙara lokaci axis, downsampling a sarari da lokaci tare. Ta matsar da girman ɗan lokaci, hanyar sadarwar zata iya ɗaukar cikakken shirin a ƙwaƙwalwar ajiya kuma ta yi amfani da juzu'i da hankali a duk firam lokaci guda. Saboda yana haifar da kowane firam a cikin fasfo guda ɗaya maimakon haɗawa tsakanin ƙananan firam ɗin maɓalli, sakamakon motsi ya fi daidaito a duniya.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar Lumiere Space-Time Bidiyo Generation
Hanyar wucewa ɗaya ta Lumiere, cikakkiyar falsafar tsawon lokaci tana tasiri yadda filin ke tunani game da haɗin kai na ɗan lokaci, kamar yadda ƙuduri da tsayin faifan bidiyo ke ci gaba da hawa kan tsarin gasa. Samfuran bidiyo na gaba za su iya haɗa gine-gine na lokaci-lokaci tare da matsi mafi wayo don matsawa zuwa tsayi, mafi girman ƙuduri, shirye-shiryen bidiyo masu iya sarrafawa. Yi tsammanin ci gaba da ci gaba akan sarrafawar gyare-gyare, ƙayyadaddun raye-rayen yanki, da ilimin kimiyyar lissafi na gaskiya, tare da haɓaka hankali ga tabbatarwa da alamar ruwa kamar yadda irin waɗannan kayan aikin ke sa bidiyo mai gamsarwa na roba da sauƙi don samarwa.
Aiwatar da Gaskiyar Duniya
Juya saƙon rubutu kai tsaye zuwa shirin motsi na ƴan daƙiƙa mai daidaituwa
Ƙirƙirar silimagraphs waɗanda ke rayar da ruwa ko gashi kawai a cikin wani hoto mai rikitarwa
Aiwatar da salo mai salo, kamar sana'ar takarda ko launin ruwa, akai-akai a cikin bidiyon da aka ƙirƙira
Zanen bidiyo don saka ko cire abu mai motsi yayin kiyaye motsi mara kyau
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lumiere Space-Time Video Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Tune-A-Video Gyaran Harbi Daya
Tambayoyin da ake yawan yi
What is Lumiere Space-Time Video Generation?
Lumiere samfurin watsa rubutu-zuwa-bidiyo ne daga Google Bincike wanda ke samar da cikakken shirin bidiyo lokaci guda ta amfani da Space-Time U-Net. Yana da mahimmanci saboda yana magance daidaito na ɗan lokaci a matakin gine-gine, yana samar da sassauci, mafi daidaituwar motsi fiye da bututun da ke haɗa firam ɗin maɓalli tare.
Menene ma'anar fasalin gine-gine na Lumiere?
Lumiere's Space-Time U-Net (STUNet) yana ƙaddamar da samfurori a cikin sarari da lokaci don samar da cikakken ɗan lokaci a cikin wucewa ɗaya.
Ta yaya Lumiere ya bambanta da samfuran bidiyo na cascade na gama gari?
Maimakon samar da firam ɗin maɓalli mai nisa da cike giɓi, Lumiere yana samar da duk tsawon lokacin a cikin madaidaicin madaidaicin hanya.
Wace matsala ƙirar wucewa ɗaya ta Lumiere ta fi inganta kai tsaye?
Ta hanyar samun hanyar sadarwa guda ɗaya ta ga duk tsarin lokaci, Lumiere yana samun ƙarin daidaituwar motsin duniya, ƙarancin motsi.
A cikin waɗanne nau'o'i ne Space-Time U-Net ya rage misali?
STUNet downsamples a fadin sararin samaniya da lokaci tare, damfara da shirin don haka cikakken video daidai da Frames ana sarrafa tare.
Wanne tasiri na ƙirƙira, mai rayar da wani ɓangaren hoto kawai, Lumiere yana tallafawa?
Lumiere na iya samar da silimagraphs, yana rayar da wani yanki da aka zaɓa na hoton da ba haka ba.