Gukora-A-Video Umwandiko-Kuri-Video
Gukora-A-Video ni __AIU_PROTECTED_13 __ ya 2022 ya sisitemu ihindura inyandiko yihuta muri videwo ngufi itarigeze ihugura kubirango byanditseho amashusho.
Incamake
It matters because it showed that the visual knowledge inside text-to-image models could be 'taught' to move using only unlabeled video.
Kwibira cyane
Gukora-A-Video, yatangajwe na Meta AI muri Nzeri 2022, itanga amasegonda make ya videwo mu nteruro nka 'imbwa yambaye cape y'intwari iguruka mu kirere.' Amayeri yingenzi ni ugukuramo isura uhereye ku cyerekezo: icyitegererezo-cy-ishusho (cyubatswe ku buryo bwa CLIP-buhuriweho n’inyandiko-shusho hamwe no gukwirakwizwa) yiga uko ibintu bisa kuva miriyari y’amashusho yanditseho, mu gihe ibice bitandukanye bya spatiotemporal byiga uburyo ibintu biva kuri videwo itashyizweho ikimenyetso wenyine. Ibi bikuraho ubuke bwibisobanuro byiza-byanditse-videwo byombi. Icyitegererezo fatizo gitanga ibisubizo-bike, buke-ikadiri-igipimo cya clips, hanyuma imiyoboro yabugenewe interpolate ikadiri yinyongera kandi ikazamuka hejuru. Igisubizo cyari gihuje neza nigihe cyacyo, nubwo amashusho yari mugufi, adasobanutse, kandi yakundaga guhindagurika.
Ubushishozi
Gukora-A-Video yongerera 2D ishusho-ibisekuruza byerekana no kwitondera muri 3D wongeyeho pseudo-by'agateganyo. Ibipimo byateganijwe byateganijwe byahagaritswe cyangwa bikurikiranwa neza mugihe ibice bishya byigihe gito biga kwimuka bivuye kuri videwo mbisi, bityo rero nta birango byanditse-videwo bikenewe. Urusobekerane-interpolation urusobe noneho rwuzuza ingengabihe hamwe na super-resolution diffuzione modules izamura ibisobanuro birambuye, ihinduranya ikarito 16-ikadiri, umushinga wo hasi-resi ihinduka clip yoroshye, ikarishye mumashanyarazi.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ko Gukora-A-Video Umwandiko-Kuri-Video
Gukora-A-Video ishusho-yabanjirije-wongeyeho-utabigenewe-utanga ibyerekezo byimbuto byanditse kuri videwo. Abamukomokaho bashimangira birebire, birebire-binini, amashusho yigihe gito hamwe na kamera ishobora kugenzurwa na majwi. Tegereza igitekerezo cyibanze, ukoreshe ubumenyi bunini bwibishusho hamwe nigikorwa cyo kwiga bihendutse, kugirango ukomeze nubwo imyubakire ihinduka yerekeza kuri transformateur ishingiye kuri diffuzione yihishe hamwe na moderi ihuriweho nayo yemera amashusho cyangwa videwo yo guhindura no gukomeza.
Gushyira mu bikorwa Isi
Kwerekana interuro imwe isobanura muri clip ngufi ya cliping kurubuga rusange
Kuzana igitekerezo gihamye nk '' idubu idubu ishushanya ishusho 'mubuzima nkikigereranyo gikora ku mutima
Interpolating hagati yabakoresha-bombi batanzwe amashusho kugirango bakore amashusho yinzibacyuho
Gukora ibishushanyo mbonera byerekana amashusho yatekerejweho mbere yo gufata amashusho
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Make-A-Video Text-to-Video quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Sora na Text-to-Video
Ibibazo bikunze kubazwa
What is Make-A-Video Text-to-Video?
Gukora-A-Video ni __AIU_PROTECTED_13 __ ya 2022 ya sisitemu ihindura inyandiko yihuta muri videwo ngufi itarigeze ihugura kubirango byanditseho amashusho. Nibyingenzi kuko byerekanaga ko ubumenyi bugaragara imbere yimyandikire-y-ishusho bishobora 'kwigishwa' kwimuka ukoresheje videwo gusa.
Ni ubuhe buryo bushya bwatumaga Make-A-Video yirinda gukenera inyandiko-yerekana amashusho?
Gukora-A-Video ikemura ikibazo: icyitegererezo-cy-ishusho cyerekana uko ibintu bimeze uhereye kumashusho yanditseho, mugihe ibice bitandukanye byigihe gito biga kwerekanwa na videwo mbisi, itashyizweho ikimenyetso.
Nigute Gukora-A-Video byongerera ubushobozi bwo kwerekana icyitegererezo?
Yagura 2D ahantu hatandukanye no kwitabwaho hamwe nuburyo bushya bwigihe gito biga uburyo ibirimo bihinduka mugihe.
Ikadiri-interpolation hamwe na super-resolution ibyiciro ikora iki?
Nyuma yimikorere mike-res, hasi-ikadiri-igipimo cyimishinga, interpolation yongeramo amakadiri na super-reaction modules izamura imyanzuro.
Ni ubuhe buryo busanzwe bwo gukora-A-Video isohoka?
Amashusho yari amasegonda make, ugereranije ni make, kandi akunda guhindagurika byigihe gito no kugoreka.