UMHLAHLANDLELA WE-AI womsindo

I-Moshi Full-Duplex Speech

I-Moshi iwumthombo ovulekile, izwi le-AI lesikhathi sangempela elivela e-Kyutai elikhuluma futhi lilalele ngesikhathi esisodwa - i-duplex egcwele - esikhundleni sokushintshana ngokuqinile.

Uhlolojikelele

I-Moshi Full-Duplex Speech ihlezi ku-audio-AI workflows eguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.

I-Deep Dive

I-Moshi, ekhishwe ilebhu yesiFulentshi i-Kyutai ngo-2024, iyimodeli yesisekelo senkulumo-enkulumweni eyakhelwe ingxoxo yemvelo, yokubambezeleka okuphansi. Ngokungafani nabasizi bepayipi abahlanganisa inkulumo nombhalo, bese kuba imodeli yolimi, bese kuba umbhalo-kuya-enkulumweni, iMoshi iphatha umsindo ngokuqondile nangokuqhubekayo. Umbono wayo oyinhloko uyi-duplex egcwele: imodela imifudlana yomsindo emibili ngesikhathi esisodwa - okomsebenzisi neyakhe - ukuze ilalele ngenkathi ikhuluma, isingathe ukuphazamiseka, i-backchannel nge-'mhm,' futhi idlulele ngokwemvelo njengoba kwenza abantu. Ifinyelela ukubambezeleka okungama-millisecond angu-160-200, ngaphansi kakhulu kwe-lag yomsizi evamile. Ngaphansi kwe-hood ihlanganisa imodeli yolimi lombhalo nomsindo engu-7B (i-Helium) kanye ne-Mimi, i-neural codec yomsindo ecindezela inkulumo ibe amathokheni acacile imodeli engawakhiqiza. U-Kyutai ukhiphe izisindo nekhodi obala.

I-Technical Insight

Iqhinga likaMoshi i-Mimi codec, eguqula umsindo oqhubekayo ube ukusakazwa okuphansi kwe-bitrate yamathokheni acwebile ku-12.5 Hz, okuhlanganisa nethokheni ye-semantic encibilikisiwe. Imodeli yolimi ibikezela amathokheni enkulumo kanye neyomsebenzisi ekusakazeni okuhambisana nesikhathi, ngakho isizukulwane akumele sime ukuze 'silalele.' Indlela 'ye-Inner Monologue' ibikezela umbhalo ngaphambi komsindo, ithuthukisa ikhwalithi yolimi nokuhambisana kwalokho okushiwo yiMoshi.

I-Mastering Moshi Full-Duplex Speech

I-Moshi iwumthombo ovulekile, izwi le-AI lesikhathi sangempela elivela e-Kyutai elikhuluma futhi lilalele ngesikhathi esisodwa - i-duplex egcwele - esikhundleni sokushintshana ngokuqinile. Lokho kususa i-lag engalungile kanye nokujika okuqinile kwabasizi bezwi bendabuko. I-Moshi Full-Duplex Speech ihlezi ku-audio-AI workflows eguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-Moshi Full-Duplex Speech njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho uhlelo olungakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa i-Moshi Full-Duplex Speech aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthunyelwa. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa le-Moshi Full-Duplex Speech

I-Full-duplex modelling isiba isifanekiso sezwi lemvelo le-AI, elithonya amasistimu kuyo yonke imboni. Lindela izinguqulo ezincane, ezikudivayisi, usekelo lwezilimi eziningi, ukubambezeleka okuphansi, nokuhlanganiswa kubasebenzeli, isevisi yamakhasimende, namathuluzi okufinyelela. Ngenxa yokuthi iMoshi ivuliwe, abacwaningi bangayiphenya futhi bayithuthukise ngokukhululekile. Izinselelo zihlala zimayelana nokwethenjwa kweqiniso, ukuphepha enkulumweni egqagqene, kanye nokushintshashintsha kwemizwelo, kodwa ukusuka engxoxweni eqinile iye engxoxweni ewuketshezi, ephazamisekayo kungenzeka ingunaphakade.

Ukuqaliswa Komhlaba Wangempela

Uzakwabo wezwi we-hands-free ongamphazamisa maphakathi nomusho, ngezimpendulo ngaphansi kwama-millisecond angu-200.

Vula isisekelo socwaningo sokufunda inkhulumomphendvulwano yesikhathi sangempela, eyi-duplex egcwele ngaphandle kwamabhokisi amnyama okuphathelene.

Izilekeleli zokufinyeleleka ezixoxa kahle nabasebenzisi abadinga ukubuyela emuva naphambili okusheshayo, okungokwemvelo.

I-Prototyping ama-bot ezwi esevisi yekhasimende angaphazamiseki angemuva futhi asabele ngenkathi ofonayo esakhuluma.

Amaphethini Okusebenzisa

I-Moshi Full-Duplex Speech in practice

Uzakwabo wezwi we-hands-free ongamphazamisa maphakathi nomusho, ngezimpendulo ngaphansi kwama-millisecond angu-200.

Uzakwethu wezwi elingenazandla ongamphazamisa phakathi nomusho, ngezimpendulo ezingaphansi kwama-millisecond angu-200 Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamacala asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Moshi Full-Duplex Speech in practice

Vula isisekelo socwaningo sokufunda inkhulumomphendvulwano yesikhathi sangempela, eyi-duplex egcwele ngaphandle kwamabhokisi amnyama okuphathelene.

Vula isisekelo socwaningo sokutadisha inkhulumomphendvulwano yesikhathi sangempela, eyiduplex egcwele ngaphandle kwamabhokisi amnyama okuphathelene Amathimba ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Moshi Full-Duplex Speech in practice

Izilekeleli zokufinyeleleka ezixoxa kahle nabasebenzisi abadinga ukubuyela emuva naphambili okusheshayo, okungokwemvelo.

Abasizi bokufinyelela abaxoxa kahle nabasebenzisi abadinga amathimba asheshayo, angokwemvelo abuyela emuva naphambili ngokuvamile athola imiphumela engcono uma echaza imikhawulo yekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Moshi Full-Duplex Speech in practice

I-Prototyping ama-bot ezwi esevisi yekhasimende angaphazamiseki angemuva futhi asabele ngenkathi ofonayo esakhuluma.

I-Prototyping amabhothi ezwi esevisi yekhasimende aphazamiseka ngemuva futhi asabele ngenkathi ofonayo esakhuluma Amathimba ngokuvamile athola imiphumela engcono lapho echaza izilinganiso zekhwalithi ngaphambili, agcine indlela yokukhuphuka yomuntu yamacala abucayi, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole

Izwi AI

Funda ukuthi amasistimu enkulumo abona futhi akhiqize kanjani ulimi.

Funda Umhlahlandlela

Umculo we-AI

Qonda amathuluzi esimanjemanje esizukulwane somculo kanye nemikhawulo.

Funda Umhlahlandlela