AudioLM
AudioLM ni Google urwego rwubushakashatsi rutanga amajwi afatika - imvugo cyangwa umuziki wa piyano - mu gufata amajwi nkururimi no guhanura ko ari ikimenyetso.
Incamake
It matters because it showed you can produce coherent, natural-sounding audio continuations without any text transcript or musical score.
Kwibira cyane
Yatangijwe na Google muri 2022, AudioLM ivugurura amajwi yerekana amajwi nkikibazo cyo kwerekana ururimi: ihindura imivumba mbisi mu bimenyetso byihariye hanyuma igahanura ikimenyetso gikurikira, nkuko icyitegererezo cyanditse gihanura ijambo rikurikira. Amayeri yingenzi ni urwego rwubwoko bwibimenyetso. Ibimenyetso bya 'Semantic' (biva kuri moderi nka w2v-BERT) bifata imiterere ndende - fonetika, syntax, melody - mugihe ibimenyetso bya 'acoustic' (biva kuri codec ya SoundStream neural codec) bifata ibisobanuro byiza nkibiranga abavuga, timbre, nuburyo bwo gufata amajwi. Kubanza guhanura ibimenyetso bisobanura, hanyuma ugashyiraho ibimenyetso bya acoustic kuri bo, AudioLM itanga ibikomeza bikomeza kumara amasegonda menshi mugihe ubitse ijwi cyangwa igikoresho cyambere. Uhaye amasegonda make yo kuvuga, ikomeza kuvuga mwijwi rimwe; yahawe piyano, itezimbere muburyo bumwe.
Ubushishozi
AudioLM yatojwe gusa kumajwi - nta nyandiko-mvugo. SoundStream ikanda amajwi mukimenyetso cya acoustic ikoresheje umubare wa vector usigaye, mugihe w2v-BERT itanga ibimenyetso simusiga. Igice cyururimi rwimiterere ya Transformer gihanura ibimenyetso mubyiciro: semantique ubanza kumiterere, hanyuma ibimenyetso bito kandi byiza bya acoustic byo kwiyubaka cyane. Decoder ya SoundStream amaherezo ihindura ibimenyetso byahanuwe bigasubira mumurongo wumuhengeri, bitanga amajwi atuma ijwi ryumuvugizi hamwe nibyiza bigenda bihinduka.
Ingaruka z'Ingamba
Kugera no kugera
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Igiciro na bije
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Umuvuduko n'igipimo
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Kazoza ka AudioLM
Ikirangantego cya AudioLM cyabaye ishingiro rya sisitemu nyuma: __AIU_PROTECTED_11 __ 'ibitekerezo bya AudioLM byahawe muri MusicLM kubwinyandiko-ku-muzika na SoundStorm kubisekuru byihuse, mugihe umurima mugari ubu uhuza ibimenyetso bya semantique na acoustic mumvugo, umuziki, ningaruka zijwi. Tegereza byihuse, igihe-nyacyo, ibisekuruza birebire hamwe, hamwe na multimodal igenzura aho inyandiko cyangwa ibindi bimenyetso byerekana gusa amajwi yatojwe amajwi. Tekinike imwe nayo ikarishye impungenge zijyanye no gutondeka amajwi hamwe nimbaraga zamajwi.
Gushyira mu bikorwa Isi
Gukomeza clip ngufi yijwi mumajwi imwe ya disikuru hamwe na intonasiyo nta nyandiko-mvugo
Gutezimbere imiziki mishya ya piyano ihuye nuburyo bwigihe gito cyanditse
Gukora nkamajwi-ibisekuruza byamajwi ya sisitemu-yumuziki nka MusicLM
Ubushakashatsi mubijyanye no kuvuga imvugo ibika prosody no gufata amajwi acoustics uhereye kuri sample
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AudioLM quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ijambo ryibanze Gutondeka no Gukangura Amagambo
Ibibazo bikunze kubazwa
What is AudioLM?
AudioLM ni Google urwego rwubushakashatsi rutanga amajwi afatika - imvugo cyangwa umuziki wa piyano - mu gufata amajwi nkururimi no guhanura ko ari ikimenyetso. Nibyingenzi kuko byerekanaga ko ushobora kubyara amajwi, asanzwe-yumvikana amajwi adafite inyandiko-mvugo cyangwa amanota yumuziki.
Ni ikihe gitekerezo cy'ibanze AudioLM ikoresha mu gutanga amajwi?
AudioLM ihindura imiterere yibimenyetso kandi ikabiteganya uko bikurikirana, ikoresha uburyo bukurikira-bwerekana uburyo bw'indimi kumajwi mbisi.
Ni uruhe ruhare rwibimenyetso bya 'semantique' muri AudioLM?
Ibimenyetso bya semantique (kuva kuri w2v-BERT) bikubiyemo imiterere yo murwego rwohejuru hamwe nubufatanye, mugihe ibimenyetso bya acoustic bifata amajwi meza.
Ni ubuhe bwoko bwa codec itanga amajwi ya acoustic ya AudioLM?
IjwiStream ikoresha igereranya rya vector isigaye kugirango igabanye amajwi mubimenyetso bya acoustic hanyuma nyuma ikuraho ibimenyetso byahanuwe bigasubira mumurongo.
Niki AudioLM isaba nkamakuru yamahugurwa?
Ikintu kigaragara ni uko AudioLM itoza gusa amajwi nta kirango cyanditse, imiterere yo kwiga iturutse kumajwi.
Kuki AudioLM ihanura ibimenyetso bisobanura mbere ya acoustic?
Kubyara imiterere idahwitse ibanza gusohora guhuza igihe; ibimenyetso bya acoustic noneho bisabwa kuri iyo miterere kugirango wongereho ubudahemuka burambuye.