Ci bi mu melGis bi ci topp
Normalisasioŋu mbind ngir wax
Audio IA
GUIDE IA Audio
Moshi Diskur bu mat sëkk
Moshi source open-source la, IA baat ci jamono dëgg bu bawoo ci Kyutai, di wax ak déglu benn yoon - full-duplex - ludul jël turn yu tar.
Déglul tegtal biiIA-nettali · ~2 min
Ci xët wii2 simili jàng
Résumé
Loolu dina dindi lag bu jaxasoo bi ak turn-taking bu dëgër bi assistant vocal yi daan am.
Plongeur bu xóot
Moshi, bi laboratwaaru Kyutai bu français genne ci 2024, xeetu fondasioŋ la buy wax-ci-kaddu, ñu tabax ko ngir waxtaan bu natureel te du yàgg. Moshi wuute na ak assistant pipeline yiy boole wax-ci-tekst, ginaaw ga modelu làkk, ginaaw ga bind-ci-kaddu, Moshi dafay jëfandikoo audio bi ci saasi te baña bàyyi. Xalaat bu mag bi mooy duplex bu mat: dafay modele ñaari stream audio ci benn yoon - jëfandikukat bi ak boppam - suko defee mu mëna déglu bi muy wax, jëflante ak dagg, backchannel ak 'mhm,' ak overlap ci nature ni nit ñi di defee. Dafay yegg ci diggante 160 ba 200 milisegond, di gëna suufeel lag assistant bi ñuy faral di def. Ci suufu kapot bi dafay boole ab modelu làkku bind ak audio bu am paramet 7B (Helium) ak Mimi, ab codec audio neural buy tënk kàddu yi ci ay token yu wuute yu model bi mëna defar. Kyutai dafa bàyyi poid yi ak kode bi ci kanam ñépp.
Doxal ci àdduna dëgg
Baat bu amul loxo mën nga dagg ci diggu frase, ak tontu ci diir bu néew 200 milisegond.
Ubbi gëstub baseline ngir jàngat ci jamono dëgg, waxtaan bu mat sëkk te amul boyet yu ñuul yuñ moomal.
Jàppalekatu yombal jëfandikoo gi di waxtaan bu baax ak jëfandikukat yi soxla dellu ak dellu ci lu gaaw te baax.
Prototyping ay bot yuy wax ci serwiisu kiliyaan yi, yuy backchannel ak di react bi ki koy woo di wax ba leegi.
Ëlëgu Moshi Kaddu Duplex
Modeling full-duplex mingi nekk royukaay ci IA baat bu natureel, di am njeexital ci sistem yi ci liggéey bi yépp. Xaarandil versioŋ yu gëna ndaw, yu nekk ci aparey bi, jàppale ci làkk yu bari, latency bu néew, ak boole ci ndawu liggéey yi, serwiisu kiliyaan yi, ak jumtukaayi yombal jëfandikoo gi. Ndax Moshi ubbeeku na, gëstukat yi mën nañu ko saytu ak gëna suqali ko ci seen bopp. Jafe-jafe yi ñu ngi des ci wàllu wóolu dëgg, kaaraange ci wax yuy jaxasoo, ak nuance yu am yëg-yëg, waaye coppite bi joge ci jël turn-taking bu dëgër dem ci waxtaan bu yomb, buy dagg, mën na nekk luy yàgg.
Teg ko ci jëf
Lu tax mu am solo
- Dugg ak yegg. Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
- Njëgg ak budget. Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
- Gaawaay ak yaatuwaay. Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Moytul
- Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
- Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
- Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Jéego yi ci topp
- Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
- Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
- Mandargal kañ la nit wara xoolaat wala nangu ay génne.
- Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Bulletin bu amul fayda
Jàngal xibaar AI bu bes
Ñatti jaar-jaari IA yuñ firndeel bis bu nekk ci ayu-bis bi, ñu bind leen ci Àngle bu leer. Gratis ba fàww, amul yëgle.
Benn email bis bu nekk ci ayu-bis bi. Benn klik nga dindi abonemaa bi. Dunu musa jaay wala séddoo sa adres.
Nattal sa bopp
Take the Moshi Full-Duplex Speech quiz
Feedback ci saasi ci bépp tontu, ak sertifikaa buñ mëna séddoo ak ID buñ mëna saytu soo jàllee ci njàng mi.
Jàppale njàngum IA te doo fay. AI Understanding mbootaay la buy def te Yàlla tax — amul yëgle, amul paywall, musul am. Defal ab sarax
Laaj yi ñuy faral di laaj
Luy Moshi Kaddu Duplex bu mat sëkk?
Moshi source open-source la, IA baat ci jamono dëgg bu bawoo ci Kyutai, di wax ak déglu benn yoon - full-duplex - ludul jël turn yu tar. Loolu dina dindi lag bu jaxasoo bi ak turn-taking bu dëgër bi assistant vocal yi daan am.
Luy 'full-duplex' ci wàllu Moshi?
Full-duplex dafay tekki ni model bi dafay jëfandikoo audio biy dugg ak biy genn benn yoon, suko defee mu mëna déglu bi muy wax te mëna jëfandikoo ay dagg ci boppam.
Ban mbootaay moo bàyyi Moshi?
Kyutai moo defar Moshi ba noppi ubbi ko, di labo gëstukat ci juntuwaay yu bees yu français, ci 2024.
Luy Mimi ci sistemu Moshi?
Mimi mooy codec audio neuronal biy dajale kàddu yu wéy yi ci biir benn bitrate bu woyof ci ay token yu wuute yu model bi mëna defar.
Lan moo wuutale Moshi ak gasoduk assistant vocal bu yàgg bi?
Jàppalekatu cosaan yi dañuy boole wax-ci-tekst, xeetu làkk, ak mbind-ci-kaddu; Moshi benn xeetu wax-ci-kaddu la buy jëfandikoo audio bi saa yu nekk.
Lu tollu ci ban latency ci waxtaan la Moshi di wut?
Moshi mingi am latency buy tollu ci diggante 160 ba 200 ms, di gëna suufeel assistant vocal yi ñuy faral di def, loolu mooy tax ñu mëna jaxasoo ak dagg.
Weyal di jàng
Gid yu jëm ci loolu
Tann nañu yeneen njiit ngir topic bii