Overview
Kling imhando yepamusoro-soro yemavara-kune-vhidhiyo modhi kubva kuChinese tekinoroji hofori Kuaishou, inokwanisa kugadzira zvikamu zvinobatika zvine kufamba kwakasimba uye fizikisi. Zvinokosha seanotungamira asiri wekuMadokero kukwikwidza kuOpenAI's Sora nemamwe majenareta evhidhiyo.
Kling naKuaishou inonzwisiswa zvakanyanya mumamiriro ehurongwa, kuwana modhi, sarudzo dzepuratifomu, uye ecosystem kudyidzana.
Deep Dive
Kling (Keling) igadziriso yevhidhiyo yakavhurwa muna Chikumi 2024 naKuaishou, iyo Beijing-based kambani kuseri kweiyo yakakurumbira vhidhiyo pfupi app inokwikwidza Douyin/TikTok kuChina. Kling akamira panze pakugadzira zvimedu zvinosvika maminetsi maviri pakureba pamafuremu makumi matatu pasekondi imwe neimwe mu1080p, aine zvinonyatsoita kufamba, kutaridzika kwechiso, uye kuomerera kumasimba emuviri semadire anoita zvinwiwa kana kuti jira rinofamba. Inotsigira mavara-kune-vhidhiyo, mufananidzo-kune-vhidhiyo, uye maficha akadai sekufamba bhurashi, kamera control, uye lip-sync. Kuaishou yakakurumidza kudzokororwa kuburikidza neshanduro (Kling 1.5, 1.6, 2.0 uye kupfuura), inovandudza kutevedzera nekukurumidza uye kunaka. Nekuti Kuaishou ane hukuru hukuru hwepfupi-fomu vhidhiyo data uye inoshandira mazana emamiriyoni evashandisi, Kling inomisikidzwa ese sechishandiso chemusiki uye chiratidziro chekugona kweChinese muganhu weAI.
Technical Insight
Kling inosanganisa diffusion-transformer (DiT) dhizaini ine 3D spatiotemporal kutarisisa, ichiirega ichienzanisira mafambiro uye mafambisirwo ezvinhu nekufamba kwenguva kwete kubata mafuremu zvakazvimirira. Iyo yakasiyana-siyana autoencoder inodzvanya vhidhiyo mune compact latent nzvimbo yekugadzira inoshanda, uye modhi inodzidziswa kuremekedza kugoneka kwemuviri. Motion bhurashi uye zvidzoreso zvekamera zvinopa vashandisi nzira dzakanangana, ukuwo diffusion denoising inovakazve akadzama, akakwirira-resolution mafuremu kubva kune ruzha rwakaiswa pakukurumidza.
Kudzidzira Kling naKuaishou
Kling imhando yepamusoro-soro yemavara-kune-vhidhiyo modhi kubva kuChinese tekinoroji hofori Kuaishou, inokwanisa kugadzira zvikamu zvinobatika zvine kufamba kwakasimba uye fizikisi. Zvinokosha seanotungamira asiri wekuMadokero kukwikwidza kuOpenAI's Sora nemamwe majenareta evhidhiyo. Kling naKuaishou inonzwisiswa zvakanyanya mumamiriro ehurongwa, kuwana modhi, sarudzo dzepuratifomu, uye ecosystem kudyidzana. Kuti uvake kunzwisisa kwakadzama, bata Kling naKuaishou semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodiwa, kujekesa fungidziro, uye patsanura zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Kling neKuaishou zvinoongorora zano revatengesi, kuvimbika kwemepu yemugwagwa, uye njodzi yekuvhara isati yaita. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera. Panguva imwecheteyo, zviziviso zveLaunch zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera.
Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi.
Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika.
Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Mugadziri wevhidhiyo pfupi paKuaishou anosimudzira bhodhi renyaya kuita clip yekusimudzira yakakwenenzverwa isina kutora firimu.
Mutengesi e-commerce anogadzira zvigadzirwa zvekuratidzira mavhidhiyo anoratidza zvinhu mukufamba chaiko.
Mugadziri wemufirimu anoshandisa mufananidzo-kune-vhidhiyo uye zvidzoreso zvekamera kufanoona chiitiko chisati chapfurwa chaicho.
Mushambadziri anogadzira akawanda emunharaunda mavhidhiyo akasiyana emushandirapamwe nekukurumidza uye zvakachipa.
Maitiro Ekuita
Kling naKuaishou mukuita
Mugadziri wevhidhiyo pfupi paKuaishou anosimudzira bhodhi renyaya kuita clip yekusimudzira yakakwenenzverwa isina kutora firimu.
Mugadziri wevhidhiyo pfupi-pfupi paKuaishou anonakisa bhodhi renyaya kuita yakakwenenzverwa yekusimudzira klipu isina kudhirowa Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Kling naKuaishou mukuita
Mutengesi e-commerce anogadzira zvigadzirwa zvekuratidzira mavhidhiyo anoratidza zvinhu mukufamba chaiko.
Mutengesi e-commerce anogadzira zvigadzirwa zvekuratidzira mavhidhiyo anoratidza zvinhu mune echokwadi mafambiro Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Kling naKuaishou mukuita
Mugadziri wemufirimu anoshandisa mufananidzo-kune-vhidhiyo uye zvidzoreso zvekamera kufanoona chiitiko chisati chapfurwa chaicho.
Mugadziri wemufirimu anoshandisa mufananidzo-kune-vhidhiyo uye zvinodzora zvekamera kufungidzira chiitiko chisati chapfurwa chaihwo Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura zvikumbaridzo zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Kling naKuaishou mukuita
Mushambadziri anogadzira akawanda emunharaunda mavhidhiyo akasiyana emushandirapamwe nekukurumidza uye zvakachipa.
Mushambadzi anogadzira akawanda emunharaunda mavhidhiyo akasiyana emushandirapamwe nekukurumidza uye zvakachipa Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Zviziviso zvekutanga zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows.
Mitengo yeAPI kana shanduko yepolicy inogona kukanganisa fungidziro husiku.
Kutsamira kune mumwe-mutengesi kunowedzera kukiya-mukati uye mari yekufambisa.
Implementation Roadmap
Ongorora vanopa uchishandisa ako ega mabasa uye dataset.
Ongorora vanopa uchishandisa ako ega mabasa uye dataset. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa.
Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi.
Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata.
Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.