Incamake
AudioLM ni Google urwego rwubushakashatsi rutanga amajwi afatika - imvugo cyangwa umuziki wa piyano - mu gufata amajwi nkururimi no guhanura ko ari ikimenyetso. Nibyingenzi kuko byerekanaga ko ushobora kubyara amajwi, asanzwe-yumvikana amajwi adafite inyandiko-mvugo cyangwa amanota yumuziki.
AudioLM yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.
Kwibira cyane
Yatangijwe na Google muri 2022, AudioLM ivugurura amajwi yerekana amajwi nkikibazo cyo kwerekana ururimi: ihindura imivumba mbisi mu bimenyetso byihariye hanyuma igahanura ikimenyetso gikurikira, nkuko icyitegererezo cyanditse gihanura ijambo rikurikira. Amayeri yingenzi ni urwego rwubwoko bwibimenyetso. Ibimenyetso bya 'Semantic' (biva kuri moderi nka w2v-BERT) bifata imiterere ndende - fonetika, syntax, melody - mugihe ibimenyetso bya 'acoustic' (biva kuri codec ya SoundStream neural codec) bifata ibisobanuro byiza nkibiranga abavuga, timbre, nuburyo bwo gufata amajwi. Kubanza guhanura ibimenyetso bisobanura, hanyuma ugashyiraho ibimenyetso bya acoustic kuri bo, AudioLM itanga ibikomeza bikomeza kumara amasegonda menshi mugihe ubitse ijwi cyangwa igikoresho cyambere. Uhaye amasegonda make yo kuvuga, ikomeza kuvuga mwijwi rimwe; yahawe piyano, itezimbere muburyo bumwe.
Ubushishozi
AudioLM yatojwe gusa kumajwi - nta nyandiko-mvugo. SoundStream ikanda amajwi mukimenyetso cya acoustic ikoresheje umubare wa vector usigaye, mugihe w2v-BERT itanga ibimenyetso simusiga. Igice cyururimi rwimiterere ya Transformer gihanura ibimenyetso mubyiciro: semantique ubanza kumiterere, hanyuma ibimenyetso bito kandi byiza bya acoustic byo kwiyubaka cyane. Decoder ya SoundStream amaherezo ihindura ibimenyetso byahanuwe bigasubira mumurongo wumuhengeri, bitanga amajwi atuma ijwi ryumuvugizi hamwe nibyiza bigenda bihinduka.
Kumenya AudioLM
AudioLM ni Google urwego rwubushakashatsi rutanga amajwi afatika - imvugo cyangwa umuziki wa piyano - mu gufata amajwi nkururimi no guhanura ko ari ikimenyetso. Nibyingenzi kuko byerekanaga ko ushobora kubyara amajwi, asanzwe-yumvikana amajwi adafite inyandiko-mvugo cyangwa amanota yumuziki. AudioLM yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata AudioLM nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha AudioLM afata ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Gukomeza clip ngufi yijwi mumajwi imwe ya disikuru hamwe na intonasiyo nta nyandiko-mvugo
Gutezimbere imiziki mishya ya piyano ihuye nuburyo bwigihe gito cyanditse
Gukora nkamajwi-ibisekuruza byamajwi ya sisitemu-yumuziki nka MusicLM
Ubushakashatsi mubijyanye no kuvuga imvugo ibika prosody no gufata amajwi acoustics uhereye kuri sample
Uburyo bwo Gushyira mu bikorwa
AudioLM mu myitozo
Gukomeza clip ngufi yijwi mumajwi imwe ya disikuru hamwe na intonasiyo nta nyandiko-mvugo.
Gukomeza clip ngufi yijwi mumajwi imwe hamwe na intonasiyo idafite amajwi mabi Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
AudioLM mu myitozo
Gutezimbere imiziki mishya ya piyano ihuye nuburyo bwigihe gito cyanditse.
Gutezimbere imiziki mishya ya piyano ihuye nuburyo bwigihe gito cyanditse Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.
AudioLM mu myitozo
Gukora nkamajwi-ibisekuruza byamajwi ya sisitemu-yumuziki nka MusicLM.
Gukora nkibisekuru byamajwi ya sisitemu ya sisitemu-yumuziki nka MuzikaLM Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
AudioLM mu myitozo
Ubushakashatsi mubijyanye no kuvuga imvugo ibika prosody no gufata amajwi acoustics uhereye kuri sample.
Ubushakashatsi kuri synthesis imvugo ibika prosody no gufata amajwi acoustics uhereye kuburugero Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.