Incamake
Mimi ni codec yamajwi yerekana amajwi agabanya imvugo mumurongo muto wibimenyetso bya discret mugihe nyacyo, kubwibyo moderi ya AI irashobora kumva no kuvuga nubukererwe buke cyane. Numugongo wamajwi inyuma ya Moshi yijwi rya Kyutai.
Mimi Streaming Audio Codec yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.
Kwibira cyane
Mimi, yasohowe na laboratoire y’Abafaransa Kyutai mu 2024, ni codec ya neural ihindura amajwi 24 kHz mu muyoboro w’ibimenyetso bya disiketi hafi ya kbps 1.1 na 12.5 gusa ku isegonda. Ikoresha kodegisi-decoder hamwe na vector isigaye (RVQ), igabanya ibimenyetso murwego rwa 'semantique' urwego rwa mbere rutandukanijwe nicyitegererezo cyo kuvuga (WavLM) hiyongereyeho urwego rwinshi rwa 'acoustic' rufata amajwi. Byibanze byuzuye kandi bitera: bisohora ibimenyetso nkuko amajwi ageze aho gutegereza clip yuzuye, hamwe na ms 80 z'ubukererwe. Ibi bituma ururimi rwicyitegererezo rufata imvugo nkibimenyetso byanditse, bigafasha Moshi kuganira muri duplex yuzuye mugihe amajwi yubatswe yubatswe yumvikana kandi asanzwe.
Ubushishozi
Amayeri ya Mimi ni gahunda yo gutandukana-RVQ. Igitabo cya mbere codebook yatojwe hamwe no gutakaza igihombo kugirango ihuze ibyashizwe muri WavLM, bikayihatira gutwara 'ibisobanuro' bya fonetike, mugihe ibitabo bisa na acoustic codebooks byubaka ibisobanuro birambuye. Transformer ikorera imbere mu cyuho, kandi igihombo cyo guhangana (GAN) kuri decoder gikarisha ubwiza bwibisohoka. Impamvu zitera zituma ibintu byose bigenda neza, bityo ubukererwe buguma hafi ms 80.
Kumenya Mimi Streaming Audio Codec
Mimi ni codec yamajwi yerekana amajwi agabanya imvugo mumurongo muto wibimenyetso bya discret mugihe nyacyo, kubwibyo moderi ya AI irashobora kumva no kuvuga nubukererwe buke cyane. Numugongo wamajwi inyuma ya Moshi yijwi rya Kyutai. Mimi Streaming Audio Codec yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata Mimi Streaming Audio Codec nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Mimi Streaming Audio Codec ifata ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Guha imbaraga Moshi ya Kyutai yuzuye-duplex umufasha wijwi kugirango ishobore kumva no kuvuga icyarimwe
Gutondeka imvugo yerekana urugero rwururimi mugihe nyacyo cyo kuvuga-gusobanura
Ultra-hasi-bitrate ijwi rihamagara (~ 1.1 kbps) kubintu bikennye cyangwa byuzuye urusobe
Gufata amajwi kubijyanye no kubyara imvugo hamwe nimiyoboro-y-imvugo itanga ibitekerezo hejuru yijwi nkinyandiko
Uburyo bwo Gushyira mu bikorwa
Mimi Streaming Audio Codec mubikorwa
Guha imbaraga Moshi ya Kyutai yuzuye-duplex umufasha wijwi kugirango ishobore kumva no kuvuga icyarimwe.
Guha imbaraga Moshi yuzuye ya Kyutai umufasha wijwi kugirango ishobore gutega amatwi no kuvuga icyarimwe Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.
Mimi Streaming Audio Codec mubikorwa
Gutondeka imvugo yerekana urugero rwururimi mugihe nyacyo cyo kuvuga-gusobanura.
Amagambo yerekana imvugo muburyo bw'ururimi kubisobanuro nyabyo-byo-kuvuga-Amagambo Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Mimi Streaming Audio Codec mubikorwa
Ultra-hasi-bitrate ijwi rihamagara (~ 1.1 kbps) kubintu bikennye cyangwa byuzuye urusobe.
Ultra-low-bitrate ijwi ryahamagaye (~ 1.1 kbps) kubibazo byurusobe rukennye cyangwa rwuzuye Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Mimi Streaming Audio Codec mubikorwa
Gufata amajwi kubijyanye no kubyara imvugo hamwe nimiyoboro-y-imvugo itanga ibitekerezo hejuru yijwi nkinyandiko.
Gukuramo amajwi kubijyanye no kubyara imvugo hamwe n'umuyoboro-ku-mvugo utekereza ku majwi nk'inyandiko Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.