Hagaha AI ee Muuqaalka

Samee-A-Video Qoraal-ku-Fiidiyow

Samee-A-Video waa nidaamka 2022_AIU_PROTECTED_13__ kaas oo u beddela qoraalka degdega ah muuqaal gaaban oo aan waligiis tababbar u lahayn lammaane qoraal-muuqaal ah oo calaamadeysan.

Dhageyso hagahanAI-waa laga sheekeeyay · ~2 min

Boggaan2 daqiiqo akhri
  1. Dulmar
  2. quusid qoto dheer
  3. Dhaqangelinta Adduunka-dhabta ah
  4. Mustaqbalka Samaynta-A-Video Qoraal-ku-Fiidiyow
  5. Ku dhaqangelinta
  6. Sii wad Sahaminta
  7. Su'aalaha soo noqnoqda

Dulmar

It matters because it showed that the visual knowledge inside text-to-image models could be 'taught' to move using only unlabeled video.

quusid qoto dheer

Make-A-Video, announced by Meta AI in September 2022, generates brief video clips from text prompts. Its key trick is decoupling appearance from motion: a text-to-image model learns what things look like from paired text-image data, while separate spatiotemporal layers learn how they move from video footage with no associated text. Meta said this reduced the need for paired text-video examples and that the research used publicly available datasets. Meta also described making videos from images and creating new videos similar to existing videos. The base model produces low-resolution, low-frame-rate clips, then dedicated networks interpolate extra frames and upscale spatial resolution. The result was strikingly coherent for its era, though clips were short, blurry, and prone to flicker and warping.

Dhaqangelinta Adduunka-dhabta ah

Abuuritaanka hal jumlad oo qeexitaan ah oo loo geliyo goos goos gaaban oo loogu talagalay barta warbaahinta bulshada

Keenista fikrad taagan sida ' orso orso rinjiyeynta sawir ' nolosha sidii sawir dhaqaajinaysa

Is-dhex-galka u dhexeeya laba sawir oo adeegsaduhu keenay si loo abuuro muuqaal kala-guur oo siman

Abuurista qoraallo dhaq-dhaqaaq degdeg ah oo muuqaallo la mala awaalay oo loogu talagalay sheeko-xariifeedka ka hor duubis kasta

Mustaqbalka Samaynta-A-Video Qoraal-ku-Fiidiyow

Samee-A-Video-ka-hor-ka-hor-iyo-ka-soo-baxa-aan-calaamad-la'aanta-hab-ka-soo-baxa ayaa abuuray dhammaan mowjadaha qoraalka-ilaa-fidyaha. Faraceeda waxay xooga saaraan go'aan dheer, qaraar sare, fiilooyinka si ku meel gaadh ah u xasiloon oo leh dhaqdhaqaaq kamarad la xakamayn karo iyo maqal. Filo fikradda asaasiga ah, dib-u-isticmaalka aqoonta sawirka weyn iyo barashada dhaqdhaqaaqa raqiis ah, inay sii socoto xitaa iyadoo naqshaduhu u wareegayaan fidinta daahsoon ee ku salaysan beddelka iyo moodooyinka midaysan ee sidoo kale aqbala qaboojinta sawirka ama fiidiyoowga tafatirka iyo sii wadida.

Ku dhaqangelinta

Maxay muhiim u tahay

  • Xawaaraha iyo miisaanka. Visual AI wuxuu si otomaatig ah u samayn karaa baadhista, ogaanshaha, iyo sumadaynta hawlaha miisaanka.
  • Xulashada dhismayaasha. Kooxaha hal-abuurka leh waxay hindise karaan fikradaha si dhakhso leh iyagoo leh dib-u-eegis buugeed yar.
  • Kooxda iyo socodka shaqada. Hawlgalladu waxay isticmaali karaan calaamadaha muuqaalka iyo muuqaalka kuwaas oo markii hore adkeyd in la farsameeyo.

Iska ilaali

  • Xuquuqda sawirka iyo ogolaanshaha waxay noqon kartaa khataro sharci ah haddii caddayntu aanay caddayn.
  • Waxqabadka moodeelku wuu ku kala duwanaan karaa iftiinka, tirakoobka, iyo deegaanka.
  • Wanaagga beenta ah waxa laga yaabaa inaan la dareemin ilaa xadka kalsoonida aan la kormeerin.

Tallaabooyinka xiga

  1. Qeex shuruudaha aqbalida ee saxnaanta, dib u celinta, iyo kharashyada khaladka.
  2. Ku tijaabi xogta ku habboon xaaladaha wax soo saarka dhabta ah.
  3. Ku dar dib u eegis bini'aadamka si aad u hesho kalsoonida hoose ama saameeynta sare.
  4. Lasoco moodeel dhaqaaqa oo dib u cusboonaysii kamarada ama xogta kaydinta ka dib.

Sii wad Sahaminta

Warqad bilaash ah

Hel warbixinta maalinlaha ah ee AI

Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.

Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.

Is tijaabi

Take the Make-A-Video Text-to-Video quiz

Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.

Bilow kedis

Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq

Su'aalaha soo noqnoqda

What is Make-A-Video Text-to-Video?

Samee-A-Video waa nidaamka 2022_AIU_PROTECTED_13__ kaas oo u beddela qoraalka degdega ah muuqaal gaaban oo aan waligiis tababbar u lahayn lammaane qoraal-muuqaal ah oo calaamadeysan. Waa arrin sababtoo ah waxay muujisay in aqoonta muuqaalka gudaha moodooyinka qoraalka-u-sawir laga yaabo in 'la baro' si loo dhaqaaqo iyadoo la adeegsanayo kaliya muuqaal aan calaamad lahayn.

Maxay ahayd hal-abuurnimada udub-dhexaadka u ah Samaynta-A-Video-ga inay iska ilaaliso u baahidda lammaane-muuqaal-qoraal ah oo calaamadeysan?

Samee-A-Video-ga waxa uu furfuraa mushkiladda: qaabka qoraalka-u-sawirku waxa uu bartaa sida ay arrimuhu u eg yihiin sawirrada qoraalka ah, halka lakabyada ku meel gaadhka ah ee kala duwani ay dhaqdhaqaaqa ka bartaan muuqaal cayriin ah, oo aan calaamadayn.

Sidee Samee-A-Video ku daraa awoodda dhaqdhaqaaqa qaabka sawirka?

Waxay ku fidinaysaa 2D convolutions spatial convolutions iyo fiiro gaar ah leh lakabyo ku meel gaar ah oo cusub oo baranaya sida nuxurku isu bedelo wakhti ka dib.

Waa maxay is-dhex-galka shaxanka iyo heerarka xallinta sare?

Ka bacdi qabyo hoose oo aan fiicneyn, heer hoose oo qabyo ah, isdhexgalku wuxuu ku darayaa xirmooyin iyo cutubyada xallinta sare waxay sare u qaadaan xallinta.

Maxay ahayd xaddidaadda caadiga ah ee wax-soo-saarka Make-A-Video?

Muuqaaladu waxay ahaayeen dhowr ilbiriqsi oo keliya, xallintooduna aad u hoosayso, waxayna u nugul yihiin liidashada iyo qalloocinta.

Besides text prompts, what visual input can Make-A-Video use to create a video?

Meta said Make-A-Video can create videos from images as well as text prompts.