Lumiere Umwanya-Igihe Video Igisekuru
Lumiere nicyitegererezo cyo gukwirakwiza amashusho kuri Google Ubushakashatsi butanga amashusho yose icyarimwe ukoresheje Umwanya-Igihe U-Net.
Incamake
It matters because it tackles temporal consistency at the architecture level, producing smoother, more coherent motion than pipelines that stitch keyframes together.
Kwibira cyane
Yatangijwe mu ntangiriro za 2024, Lumiere arwanya 'urufunguzo rusanzwe hanyuma yuzuza' igishushanyo cyakoreshejwe na generator nyinshi. Ubwo buryo bwa caskade bwambere butanga urufunguzo ruto rwa kure hanyuma interpolate, irashobora gutera urujijo cyangwa rudahuye kuko ntamuyoboro numwe wigeze ubona igihe cyuzuye. Lumiere ahubwo itanga igihe cyose cyigihe gito cya clip muri pass imwe hamwe na Space-Time U-Net (STUNet). Urusobekerane rwibintu byombi mumwanya no mugihe, gutunganya amashusho yerekana amashusho yose hamwe kugirango icyerekezo gihuze isi yose. Igishushanyo kandi gishoboza urutonde rwimirimo yo guhindura nka shusho-kuri-videwo, gushushanya, ibisekuru byashushanyije, hamwe na 'cinemagraphs' byerekana akarere katoranijwe gusa.
Ubushishozi
Igitekerezo cyibanze ni Umwanya-Igihe U-Net. Igishusho gisanzwe U-Net kumanura no hejuru mubugari n'uburebure; STUNet yongeraho igihe axis, kumanura mumwanya hamwe nigihe hamwe. Muguhagarika ibipimo byigihe gito, umuyoboro urashobora gufata clip yuzuye murwibutso kandi ugashyira mu bikorwa ibyemezo no kwitondera kumurongo wose icyarimwe. Kuberako ibyara buri kintu mumurongo umwe uhuza aho guhuza hagati yurufunguzo ruke, icyerekezo cyavuyeho kirarenze kure kwisi yose.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka Lumiere Umwanya-Igihe Video Igisekuru
Lumiere imwe-imwe, filozofiya yuzuye-ihindura uburyo umurima utekereza kubijyanye nigihe gito, nubwo gukemura hamwe nuburebure bwa clip bikomeza kuzamuka kuri sisitemu zirushanwa. Moderi yigihe kizaza irashobora guhuza umwanya-umwanya wububiko hamwe no kwikuramo ubwenge kugirango bisunike birebire, birebire-binini, bigenzurwa. Witege ko hazakomeza kubaho iterambere muguhindura igenzura, animasiyo yihariye yakarere, hamwe na fiziki ifatika, hamwe no kurushaho kwita kubimenyekanisha no kwerekana amazi nkibikoresho nkibi bituma amashusho yubukorikori yemeza gukora byoroshye.
Gushyira mu bikorwa Isi
Guhindura inyandiko ihita ihinduka muri make-isegonda ya clip
Gukora cinemagraphs yerekana amazi cyangwa umusatsi gusa kumafoto ubundi aracyariho
Koresha uburyo busa, nka papercraft cyangwa watercolor, burigihe kuri videwo yakozwe
Gushushanya amashusho kugirango ushiremo cyangwa ukureho ikintu cyimuka mugihe ugumya kugenda neza
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lumiere Space-Time Video Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Tune-A-Video Imwe-imwe Guhindura
Ibibazo bikunze kubazwa
What is Lumiere Space-Time Video Generation?
Lumiere nicyitegererezo cyo gukwirakwiza amashusho kuri Google Ubushakashatsi butanga amashusho yose icyarimwe ukoresheje Umwanya-Igihe U-Net. Nibyingenzi kuko ikemura ibibazo byigihe gito kurwego rwubwubatsi, itanga icyerekezo cyoroshye, gihuza kuruta imiyoboro idoda urufunguzo.
Ni ubuhe buryo busobanura ubwubatsi bwa Lumiere?
Umwanya wa Lumiere-Igihe U-Net (STUNet) wamanutse mumwanya yombi nigihe cyo kubyara igihe cyose cyigihe gito muri pass imwe.
Lumiere atandukaniye he na moderi ya casade isanzwe?
Aho kubyara urufunguzo rwa kure no kuzuza icyuho, Lumiere itanga ingengabihe yose mumurongo umwe uhuza.
Ni ikihe kibazo Lumiere igishushanyo mbonera kimwe cyatezimbere cyane?
Mugihe ufite umuyoboro umwe reba ingengabihe yose, Lumiere agera kuri byinshi ku isi yose, bitagenda neza.
Ni mu buhe buryo Umwanya-Igihe U-Net utanga urugero?
STUNet yerekana ahantu hamwe nigihe hamwe, guhuza clip kugirango videwo yuzuye ihure hamwe namakadiri atunganyirizwa hamwe.
Ni izihe ngaruka zo guhanga, zerekana igice gusa cyishusho, Lumiere ashyigikiye?
Lumiere irashobora gukora cinemagraphs, ikerekana akarere katoranijwe kurundi shusho ihagaze.