Audio AI GUIDE

Moshi Yakazara-Duplex Kutaura

Moshi ndeye yakavhurika-sosi, chaiyo-nguva izwi AI kubva kuKyutai inotaura uye inoteerera panguva imwe chete - yakazara-duplex - pane kutora majana akasimba.

2 min verengaLast update

Pfupiso

That removes the awkward lag and rigid turn-taking of traditional voice assistants.

Kudzika Kwakadzika

Moshi, yakaburitswa neFrench lab Kyutai muna 2024, imhando yekutaura-ku-kutaura-nheyo yakavakirwa kune yakasikwa, yakaderera-latency hurukuro. Kusiyana nemapaipi vabatsiri vanobatanidza kutaura-kune-mavara, ipapo modhi yemutauro, ipapo mavara-kune-kutaura, Moshi inobata odhiyo zvakananga uye ichienderera. Pfungwa yayo yakakosha ndeye duplex yakazara: inoenzanisira maodhiyo hova maviri panguva imwe chete - yemushandisi neyayo - saka inogona kuteerera ichitaura, inobata zvinokanganisa, backchannel ine 'mhm,' uye inopindirana zvakasikwa sezvinoita vanhu. Iyo inosvika latency yakatenderedza 160-200 milliseconds, kure pasi peyakajairwa mubatsiri lag. Pasi pehodhi inobatanidza 7B-parameter mavara-uye-odhiyo mutauro modhi (Helium) naMimi, neural audio codec inomanikidza kutaura kuita ma tokeni akasarudzika anogona kuburitswa nemuenzaniso. Kyutai akaburitsa huremu nekodhi pachena.

Technical Insight

Hunyengeri hwaMoshi ndeye Mimi codec, iyo inoshandura inoenderera odhiyo kuita yakaderera-bitrate rukova rwe discrete tokeni pa12.5 Hz, kusanganisira distilled semantic tokeni. Mutevedzeri wemutauro unofanotaura zviratidzo zvayo zvekutaura uye zvemushandisi mune hova dzinoenderana nenguva, saka chizvarwa hachimbofaniri kumira kuti 'chiteerere.' Nzira ye'Inner Monologue' inofanotaura zvinyorwa zvisati zvaitika, zvichivandudza mhando yemitauro uye kubatana kwezvinotaurwa naMoshi.

Strategic Impact

Svika uye svika

Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.

Mutengo uye bhajeti

Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.

Kumhanya uye chiyero

Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.

Ramangwana reMoshi Yakazara-Duplex Kutaura

Yakazara-duplex modelling iri kuita template yezvakasikwa izwi AI, inofurira masisitimu muindasitiri yese. Tarisira madiki, e-pa-mudziyo shanduro, rutsigiro rwemitauro yakawanda, yakaderera latency, uye kubatanidzwa muvamiririri, sevhisi yevatengi, uye maturusi ekuwanika. Nekuti Moshi yakavhurika, vaongorori vanogona kuongorora nekuivandudza vakasununguka. Matambudziko anoramba ari pamusoro pekuvimbika kwechokwadi, kuchengetedzeka mukutaura kunopindirana, uye nuance yemanzwiro, asi kusimuka kubva pakuomarara-kutora kuenda kumvura, kuvhiringika nhaurirano inogona kusingaperi.

Real-World Implementation

Mufambidzani wezwi risina maoko iwe unogona kukanganisa pakati pemutsara, nemhinduro dziri pasi pe200 milliseconds.

Vhura hwaro hwekutsvagisa yekudzidza-chaiyo-nguva, yakazara-duplex inotaurwa nhaurirano isina mabhokisi matema evaridzi.

Kuwanikwa vabatsiri vanokurukura zvinyoro-nyoro nevashandisi vanoda nekukurumidza, zvakasikwa kumashure-uye-mberi.

Prototyping inovhiringidza mutengi-sevhisi izwi bots iyo backchannel uye inopindura munhu anenge afona achiri kutaura.

Njodzi & Guardrails

Kushandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.

Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.

Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.

Implementation Roadmap

1

Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.

2

Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.

3

Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.

4

Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.

Ramba Uchiongorora

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Moshi Full-Duplex Speech quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tanga mibvunzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Gaidhi rinotevera

Kugadzirisa Mavara paKutaura

Mibvunzo inowanzo bvunzwa

What is Moshi Full-Duplex Speech?

Moshi ndeye yakavhurika-sosi, chaiyo-nguva izwi AI kubva kuKyutai inotaura uye inoteerera panguva imwe chete - yakazara-duplex - pane kutora majana akasimba. Izvo zvinobvisa kusadzikama uye kuomarara-kutora kwechinyakare vabatsiri vezwi.

Chii chinonzi 'full-duplex' muchirevo chechinyorwa cheMoshi?

Yakazara-duplex zvinoreva kuti modhi inobata odhiyo inouya uye inobuda panguva imwe chete, saka inogona kuteerera ichitaura uye kubata zvinovhiringa zvagara.

Isangano ripi rakaburitsa Moshi?

Moshi yakagadziriswa uye yakavhurika-yakavhurwa naKyutai, yeFrench AI yekutsvagisa lab, muna 2024.

Chii chinonzi Mimi muMoshi system?

Mimi ndiyo neural audio codec inomanikidza kuenderera kutaura kune yakaderera-bitrate rwizi rwe discrete tokens iyo modhi inogona kuburitsa.

Ko Moshi inosiyana sei nepombi yechinyakare inotsigira izwi?

Vabatsiri vetsika vanobatanidza kutaura-kune-mavara, muenzaniso wemutauro, uye zvinyorwa-ku-kutaura; Moshi imhando yekutaura-kune-kutaura inobata odhiyo nguva dzose.

Moshi anonangana nekutaura kunonoka kupi?

Moshi inowana latency yakatenderedza 160-200 ms, yakadzikira zvakanyanya pane yakajairwa vabatsiri vezwi, ichigonesa kupindirana kwechisikigo uye kukanganisa.