Mimi Streaming Audio Codec
Mimi waa codec maqal ah oo neural ah kaas oo hadalka ku cadaadiya qulqul yar oo calaamado kala duwan ah wakhtiga dhabta ah, markaa moodooyinka AI way dhegaysan karaan oo ku hadli karaan daahsoon aad u hooseeya.
Dulmar
It is the audio backbone behind Kyutai's Moshi voice model.
quusid qoto dheer
Mimi, oo uu sii daayay shaybaadhka Faransiiska ee Kyutai 2024, waa codec neural ah oo u beddela 24 kHz maqal ah qulqulka calaamado kala duwan oo qiyaastii 1.1 kbps iyo 12.5 calaamadood oo keliya ilbiriqsikii. Waxay adeegsataa cod-dejiye leh hadhaaga vector-ka (RVQ), u kala qaybinta calaamadaha 'semantic' heerka koowaad ee laga soocay qaabka hadalka is-maamula (WavLM) oo lagu daray dhowr heerar 'acoustic' ah oo qabsada qoraalka codka. Muhiimad gaar ah ayaa si buuxda u socota oo sababta: waxay soo saartaa calaamado marka codku yimaado halkii la sugi lahaa goos goos buuxa, oo leh ilaa 80 ms oo daahitaan ah. Tani waxay u ogolaanaysaa qaabka luqadda inuu ula dhaqmo hadalka sida calaamadaha qoraalka, taasoo awood u siinaysa Moshi inuu ku sheekeysto laba-duplex isagoo ilaalinaya maqalka dib loo dhisay mid la fahmi karo oo dabiici ah.
Aragtida Farsamada
Khiyaamada Mimi waa qorshe RVQ qaybsan. Buuga koodka kowaad waxa lagu tababbaray luminta kala-baxa si uu u dhigmo ku-xidhka WavLM, isaga oo ku qasbaya in uu sido 'macnaha' dhawaaqa, halka buugaagta cod-bixinta ee is barbar socda ay dib u dhisaan tafaasiisha qaabka hirarka. Transformer-ku waxa uu ka shaqeeyaa gudaha dhuunta, iyo khasaaraha iska soo horjeeda (GAN) ee ku yimaadda qalabka wax soo saara waxa ay soo saartaa tayada wax soo saarka. Iskudhacyada sababa ayaa wax walba ku sii qulqulaya, marka daahitaanku wuxuu ku dhawaadaa 80 ms.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka Mimi Streaming Audio Codec
Filo codec-yada sida Mimi inay noqdaan isku-xidhka caadiga ah ee u dhexeeya moodooyinka maqalka iyo luqadaha waaweyn, riixaya kaaliyeyaasha codka wakhtiga-dhabta ah ee ku wajahan 100-ka ms waqtiyada jawaabta. Cilmi baaristu waxay wadaa heerarka calaamaduhu xitaa hooseeyo iyadoo la ilaalinayo aqoonsiga hadalka, dareenka, iyo muusigga. Sababtoo ah Kyutai-furan Mimi iyo Moshi, waxay u badan tahay inay abuurto nidaamyo-hadal-ku-hadal oo badan, caawiyayaasha aaladaha, iyo aaladaha isgaarsiinta codka-bandwidth-hooseeya.
Dhaqangelinta Adduunka-dhabta ah
Awoodsiinta Kyutai's Moshi kaaliyaha cod-duplex-ka buuxa si uu u dhagaysto oo uu u hadlo isku mar
Ku shubista calaamadaha hadalka qaab luqadeed si loogu turjumo hadalka-hadalka-waqtiga-dhabta ah
Wicitaanada cod ee aadka u hooseeya (~ 1.1 kbps) ee xaaladaha shabakadaha liita ama ciriiriga ah
Calaamadaynta maqalka hadalka abuurista iyo dhuumaha qoraalka-ku-hadalka ee sabab u ah dhawaaqa sida qoraalka
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Mimi Streaming Audio Codec quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Codec-yada Maqalka Neural
Su'aalaha soo noqnoqda
What is Mimi Streaming Audio Codec?
Mimi waa codec maqal ah oo neural ah kaas oo hadalka ku cadaadiya qulqul yar oo calaamado kala duwan ah wakhtiga dhabta ah, markaa moodooyinka AI way dhegaysan karaan oo ku hadli karaan daahsoon aad u hooseeya. Waa laf dhabarta maqalka ee ka dambeysa qaabka codka Moshi ee Kyutai.
Shaybaarkee ayaa sii daayay Mimi iyo qaabka codka Moshi?
Mimi iyo Moshi waxaa lagu sii daayay 2024 shaybaarka cilmi baarista Faransiiska ee Kyutai, kaas oo labadaba il furan ka helay.
Qiyaastii imisa calaamadood ayay Mimi ku soo daysaa hadalka?
Mimi waxay ku cadaadisaa 24 kHz maqal ah ilaa 12.5 calaamado ilbiriqsikiiba qiyaastii 1.1 kbps.
Muxuu qabtaa buugii koodka ugu horeeyay ('semantic') ee ku jira qabsashada Mimi?
Heerka ugu horreeya ee RVQ waxaa lagu tababbaray iyada oo loo marayo distillation laga bilaabo WavLM si loo qaado nuxurka semantic/phonetic, halka heerarka dambe ay ku darayaan tafaasiisha acoustic.
Waa maxay sababta Mimi loogu sifeeyay inay tahay 'qulqulka' ama 'sababaha'?
Mimi waxay u habaysaa maqalka sabab ahaan waxayna soo saartaa calaamadaha si kordheysa, iyadoo siinaysa ku dhawaad 80 ms daahitaan oo ku haboon wada hadalka tooska ah.
Farsamada xisaabintee ayay Mimi isticmaashaa si ay u codeeyaan codka?
Mimi waxay adeegsataa tirooyinka hadhaaga vector-ka, iyada oo ururinaysa buugaag codeedyo badan si mid kastaaba tafaasiil fiican ugu daro kii hore.