Overview
Mumhanzi Ruzivo Kudzoreredza (MIR) inzvimbo inodzidzisa makomputa kuongorora, kunzwisisa, uye kutsvaga mimhanzi kubva kumasaini ekuteerera uye zvibodzwa. Inopa simba zvese kubva kuShazam-maitiro ekuzivikanwa kwenziyo kune Spotify kurudziro uye otomatiki mimhanzi yekumaka.
Mumhanzi Ruzivo Kudzoreredza kunogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzirwa kwenhau.
Deep Dive
Mumhanzi Ruzivo Kudzoreredza kunogara pamharadzano yechiratidzo chekugadzirisa, kudzidza muchina, uye musicology. Vatsvaguri vanobvisa maficha kubva muodhiyo senge spectrogram, mel-frequency cepstral coefficients (MFCCs), chroma vectors, uye tempo kutora pitch, timbre, rhythm, uye kuwirirana. Kubva pane izvi, masisitimu eMIR anoita mabasa senge kurova tracking, kiyi yekuona, genre classification, kudhirowa nziyo, yekuvhara-nziyo yekuzivikanwa, uye kurudziro yemimhanzi. Musangano wepagore we ISMIR pamwe nemushandirapamwe wekuongorora weMIREX wakafambisa kufambira mberi kubva 2000. Mazuva ano MIR iri kuwedzera kushandisa kudzidza kwakadzama, kudzidzisa convolutional uye transformer network zvakanangana ne spectrograms, uye inozvitarisisa yekumisikidzwa kwemaodhiyo, ichitsiva akawanda-akagadzirwa nemaoko asi achiri kuvimba nemimhanzi-dzidziso pfungwa kuisa uye kududzira mhedzisiro.
Technical Insight
Mapoipi mazhinji eMIR anotanga nekushandura odhiyo kuita inomiririra nguva-yenguva ichishandisa Short-Nguva Fourier Shanduko, kazhinji yakamonyoroka kuita mel kana log-frequency scale inotaridza kunzwa kwevanhu. Chroma inoratidzira peta ese maoctave kuita gumi nemaviri makirasi ekuwirirana mabasa, ukuwo MFCCs compress timbre. Neural network kana classifier yobva yaisa maratidziro aya kune mazita akaita se tempo, kiyi, kana rudzi. Ongororo inoshandisa metrics yakanangana nebasa senge F-measure yekutevera kurova.
Mastering Music Information Retrieval
Mumhanzi Ruzivo Kudzoreredza (MIR) inzvimbo inodzidzisa makomputa kuongorora, kunzwisisa, uye kutsvaga mimhanzi kubva kumasaini ekuteerera uye zvibodzwa. Inopa simba zvese kubva kuShazam-maitiro ekuzivikanwa kwenziyo kune Spotify kurudziro uye otomatiki mimhanzi yekumaka. Mumhanzi Ruzivo Kudzoreredza kunogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzirwa kwenhau. Kuti uvake kunzwisisa kwakadzama, bata Mumhanzi Ruzivo rwekudzoreredza semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodiwa, jekesa fungidziro, uye patsanura zvinogona kuitwa nehurongwa hwakavimbika kubva pane zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Music Information Retrieval zvinobata mhando, latency, uye mvumo sezvikamu zvakakosha zvakaenzana zvehurongwa hwekuendesa. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Panguva imwecheteyo, kusashandiswa kweIzwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Shazam uye maapplication akafanana anozivisa rwiyo kubva kune ruzha kurekodha foni uchishandisa odhiyo zvigunwe
Spotify uye Apple Music inogadzira kurudziro uye otomatiki-playlists kubva pakudzidza odhiyo kufanana
Otomatiki tagging yemafungiro, rudzi, uye zviridzwa zvekugadzira hombe-mimhanzi uye stock-audio maraibhurari.
Kutsvaga mavhezheni evhavha uye zvingangove zvinoenderana nekodzero pamapuratifomu seYouTube Content ID
Maitiro Ekuita
Mumhanzi Ruzivo Kudzoreredza mukuita
Shazam uye maapplication akafanana anozivisa rwiyo kubva kune ruzha kurekodha foni uchishandisa odhiyo zvigunwe.
Shazam uye maapplication akafanana anozivisa rwiyo kubva muruzha rwekurekodha achishandisa zvigunwe zvekuteerera Zvikwata zvinowanzowana mibairo iri nani pazvinenge zvichitsanangudza zvikumbaridzo zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Mumhanzi Ruzivo Kudzoreredza mukuita
Spotify uye Apple Music inogadzira kurudziro uye otomatiki-playlists kubva pakudzidza odhiyo kufanana.
Spotify neApple Mimhanzi inogadzira kurudziro uye otomatiki-yekutamba kubva kune akadzidziswa odhiyo kufanana Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Mumhanzi Ruzivo Kudzoreredza mukuita
Otomatiki tagging yemamodhi, rudzi, uye zviridzwa zvezvakakura zvekugadzira-mimhanzi uye stock-audhiyo maraibhurari.
Otomatiki tagging yemamodhi, mhando, uye zviridzwa zveakakura ekugadzira-mimhanzi uye stock-odhiyo maraibhurari Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Mumhanzi Ruzivo Kudzoreredza mukuita
Kutsvaga mavhezheni evhavha uye zvingangove zvinoenderana nekodzero pamapuratifomu seYouTube Content ID.
Kutsvaga mavhezheni eakavha uye anogona copyright machisi pamapuratifomu akaita seYouTube Content ID Matimu anowanzo kuwana mhedzisiro iri nani kana vachinge vatsanangura zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Kusashandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.
Implementation Roadmap
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.