Ọgbọ vidiyo Oge Oghere Lumiere
Lumiere bụ ụdị mgbasa ozi ederede gaa na vidiyo sitere na Google Nchọpụta na-ewepụta obere vidiyo n'otu oge site na iji Space-Time U-Net.
Nchịkọta
It matters because it tackles temporal consistency at the architecture level, producing smoother, more coherent motion than pipelines that stitch keyframes together.
Ime miri emi
Ewebata ya na mbido 2024, Lumiere na-agbagha ụkpụrụ 'keyframes wee mejupụta' imewe nke ọtụtụ ndị na-emepụta vidiyo na-eji. Ụzọ cascade ndị ahụ na-ebu ụzọ wepụta mkpịsị ugodi ole na ole dị anya wee megharịa ọnụ, nke nwere ike ịmepụta ihe na-adịghị mma ma ọ bụ na-ekwekọghị ekwekọ n'ihi na ọ dịghị otu netwọk na-ahụta usoro iheomume zuru ezu. Kama Lumiere na-ewepụta ogologo oge niile nke obere vidiyo n'otu ngafe ya na Space-Time U-Net (STUNet). Netwọk ahụ na-agbadata ma oghere na oge, na-ahazi kọmpat ihe nnọchianya nke vidiyo niile ọnụ ka ngagharị wee kwekọọ n'ụwa niile. Nhazi a na-emekwa ka ọrụ dị iche iche na-edezi dị ka ihe onyonyo gaa na vidiyo, ịse ihe osise, ọgbọ stylized, na 'cinemagraph' nke na-eme naanị mpaghara ka ahọpụtara.
Nghọta nka nka
Isi echiche bụ Space-Time U-Net. Ihe onyonyo ọkọlọtọ U-Net na-agbadata na elu na obosara na ịdị elu; STUNet na-agbakwụnye axis oge, na-agbadata na oghere na oge ọnụ. Site na ịpịkọta akụkụ nwa oge, netwọk nwere ike ijide obere vidiyo na ebe nchekwa ma tinye ma ntụgharị na nlebara anya n'okirikiri niile n'otu oge. N'ihi na ọ na-ewepụta etiti ọ bụla n'ime otu ngafe na-emekọrịta ihe kama ịgbakọ ọnụ n'etiti igodo igodo pere mpe, mmegharị ahụ na-esi na ya pụta na-agbanwe agbanwe karịa n'ụwa niile.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke Ọgbọ vidiyo Oge Oghere Lumiere
Otu ngafe Lumiere, nkà ihe ọmụma oge zuru oke na-emetụta ka ubi ahụ si eche maka ịdị n'otu nwa oge, ọbụlagodi mkpebi na ogologo ogologo oge na-arịgo n'usoro asọmpi. Ụdị vidiyo ga-eme n'ọdịnihu ga-agwakọta ihe owuwu oge ohere yana mkpakọ ka mma iji gaa n'ihu ogologo, mkpebi dị elu na obere vidiyo enwere ike ịchịkwa. Na-atụ anya ọganihu na-aga n'ihu na njikwa ndezi, ihe ngosi mpaghara, na physics dị adị, yana nlebara anya na-eto eto na akara mmiri dị ka ngwaọrụ ndị dị otú ahụ na-eme ka vidiyo sịntetik na-ekwenye ekwenye na-adịwanye mfe ịmepụta.
Mmejuputa n'ezie n'ụwa
Na-atụgharị ozugbo ederede ka ọ bụrụ obere vidiyo ngagharị nkeji nkeji ole na ole
Ịmepụta cinemagraph nke na-eme naanị mmiri ma ọ bụ ntutu na foto ọzọ ka dị
Na-etinye ọdịdị mara mma, dị ka akwụkwọ mpempe akwụkwọ ma ọ bụ agba mmiri, na-agafe vidiyo emepụtara
Ịtinye vidiyo iji fanye ma ọ bụ wepu ihe na-akpụ akpụ ka ọ na-eme ngagharị na enweghị nkebi
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Lumiere Space-Time Video Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Tune-A-Video Otu-mgbọ na-edezi
Ajụjụ a na-ajụkarị
What is Lumiere Space-Time Video Generation?
Lumiere bụ ụdị mgbasa ozi ederede gaa na vidiyo sitere na Google Nchọpụta na-ewepụta obere vidiyo n'otu oge site na iji Space-Time U-Net. Ọ dị mkpa n'ihi na ọ na-akwado nkwụsi ike nwa oge n'ọkwa ihe owuwu, na-eme ka ọ dị nro, na-arụkọ ọrụ ọnụ karịa pipeline na-ejikọta mkpịsị ugodi ọnụ.
Kedu ihe na-akọwapụta atụmatụ ụkpụrụ ụlọ nke Lumiere?
Ihe nlele Lumiere's Space-Time U-Net (STUNet) na-agbadata na oghere ma oge iji wepụta oge nwa oge n'otu ngafe.
Kedu ka Lumiere si dị iche na ụdị vidiyo cascade nkịtị?
Kama ịmepụta igodo igodo dị anya na imeju oghere, Lumiere na-ewepụta usoro iheomume niile n'otu ngafe ọnụ.
Kedu nsogbu nhazi otu ngafe Lumiere na-akacha mma ozugbo?
Site n'inwe otu netwọkụ hụ usoro iheomume niile, Lumiere na-enweta ihe ngbanwe zuru ụwa ọnụ yana obere ngagharị.
Kedu akụkụ ndị Space-Time U-Net na-agbadata?
STUNet downsamples gafee ohere na oge ọnụ, compressing clip otú zuru video dabara na okpokolo agba na-esichara ọnụ.
Kedu mmetụta okike, na-emegharị naanị akụkụ nke onyonyo, Lumiere na-akwado?
Lumiere nwere ike imepụta sinima, na-emegharị mpaghara ahọpụtara nke onyonyo kwụ ọtọ.