Overview
Kushandura-ku-Kutaura-Kutaura (S2ST) inotora mazwi anotaurwa mumutauro mumwe uye inogadzira mazwi anotaurwa mune mumwe - ichichengetedza izwi remutauri, matauriro, uye nguva. Ndiyo 'muturikiri wepasi rose' akatsvakwa kwenguva refu kuti ataure arimo.
Hurukuro-kune-Kutaura Dudziro inogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzira midhiya.
Deep Dive
Shanduro yeSpeech-to-Speech inoshandura maodhiyo mumutauro waunobva kuti ave maodhiyo mumutauro waunonongedza. Maitiro echinyakare ndeye cascade: kucherechedzwa kwekutaura (ASR) inonyora zvinopinza, shandurudzo yemuchina inoshandura zvinyorwa, uye zvinyorwa-ku-kutaura (TTS) inotaura mhedzisiro. Izvi zvinoshanda asi zvinounganidza zvikanganiso padanho rega rega uye zvinowedzera latency. Masisitimu matsva 'akananga' kana ekupedzisira-kusvika-kumagumo anoturikira kutaura kuenda kukutaura nematanho mashoma epakati, kuderedza kunonoka uye kuchengetedza zvirinani hunhu hwekutaura. Meta's SeamlessM4T uye Seamless suite inoturikira mumitauro ingangoita 100 uye inovavarira kuchengetedza matauriro emutauri, manzwiro, uye mutinhimira. Chinetso chakaoma inguva chaiyo, yakaderera-latency dudziro: sisitimu inofanirwa kutanga kushandura mutsara usati wapera, kuenzanisa kukurumidza kupesana nekururama.
Technical Insight
Paradigms mbiri dzinokwikwidza. Cascaded masisitimu ari modular uye ari nyore kugadzirisa asi zvikanganiso zvakasanganiswa uye kurasikirwa nezwi rekutanga. Yakananga S2ST modhi mepu sosi odhiyo yekunongedza odhiyo (kazhinji kuburikidza ne discrete acoustic units) uye inogona kumhanya-kusvika-kumagumo, kudzikisa latency uye kuchengetedza prosody. Kuturikira kushandura kunowedzera dambudziko rekusarudza nguva yekuzvipira kuburitsa mutauri asati apedza, sezvo kurongeka kwemazwi kunosiyana mumitauro uye kumirira kwenguva yakareba kunokanganisa chiitiko chiripo.
Shandura yeKutaura-ku-Kutaura
Kushandura-ku-Kutaura-Kutaura (S2ST) inotora mazwi anotaurwa mumutauro mumwe uye inogadzira mazwi anotaurwa mune mumwe - ichichengetedza izwi remutauri, matauriro, uye nguva. Ndiyo 'muturikiri wepasi rose' akatsvakwa kwenguva refu kuti ataure arimo. Hurukuro-kune-Kutaura Dudziro inogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzira midhiya. Kuti uvake kunzwisisa kwakadzama, tora Kuturikira-Kutaura-Kutaura semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvaunoda, kujekesa fungidziro, uye patsanura zvinogona kuitwa nehurongwa hwakavimbika kubva pane zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Kuturikira-Kutaura-Kutaura zvinobata kunaka, kunonoka, uye kubvuma sezvikamu zvakakosha zvakaenzana zvehurongwa hwekuendesa. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Panguva imwecheteyo, kusashandiswa kweIzwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Live vhidhiyo-call dudziro inoita kuti vatori vechikamu vataure mitauro yavo uye kunzwa mumwe nemumwe mune yavo.
Maearbuds uye magirazi eAR anoturikira nhaurirano pamhepo paunenge uchifamba kunze kwenyika.
Kutora mafirimu nemavhidhiyo mune mimwe mitauro uku uchichengetedza manzwi uye manzwiro evatauri vepakutanga.
Emergency and health care settings uko murapi nemurwere asingataure mutauro wakajairika vanogona kutaurirana nekukasika.
Maitiro Ekuita
Kushandura-Kutaura-Kutaura tichidzidzira
Live vhidhiyo-call dudziro inoita kuti vatori vechikamu vataure mitauro yavo uye kunzwa mumwe nemumwe mune yavo.
Live vhidhiyo-call dudziro iyo inoita kuti vatori vechikamu vataure mitauro yavo uye kunzwa mumwe nemumwe mune yavo Matimu anowanzo kuwana mhedzisiro iri nani kana ivo vachitsanangura hunhu hwepamberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Kushandura-Kutaura-Kutaura tichidzidzira
Maearbuds uye magirazi eAR anoturikira nhaurirano pamhepo paunenge uchifamba kunze kwenyika.
Maearbuds uye magirazi eAR anoshandura nhaurirano paunenge uchifamba kunze kwenyika Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura mhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Kushandura-Kutaura-Kutaura tichidzidzira
Kutora mafirimu nemavhidhiyo mune mimwe mitauro uku uchichengetedza manzwi uye manzwiro evatauri vepakutanga.
Kudonhedza mafirimu nemavhidhiyo mune mimwe mitauro uchichengetedza manzwi evatauri vepakutanga uye Matimu emanzwiro anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura zvikumbaridzo zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Kushandura-Kutaura-Kutaura tichidzidzira
Emergency and health care settings uko murapi nemurwere asingataure mutauro wakajairika vanogona kutaurirana nekukasika.
Emergency and health care settings apo murapi nemurwere vasingataure mutauro wakafanana vanogona kutaurirana nekukasira Matimu anowanzowana mhedzisiro iri nani kana achinge atsanangura mabindu emhando kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvinobudirira kubudirira uye kukanganisa mutengo nekufamba kwenguva.
Njodzi & Guardrails
Kusashandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.
Implementation Roadmap
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.