Demucs uye HT-Demucs Music Source Separation
Demucs i Meta's open-source music source separation model; Hybrid Transformer Demucs (HT-Demucs) inotsemura nziyo kuita inzwi, chigubhu, bass, uye mamwe madzinde uchishandisa waveform uye spectrogram kugadzirisa.
Kudzika Kwakadzika
Demucs (Yakadzika Extractor yeMumhanzi Source) inobata iyo yekare "un-mixing" dambudziko: kudzoreredza ega ega echiridzwa chekurekodha kubva kune yekupedzisira stereo kurekodha. Mavhezheni ekutanga akashandisa waveform-domain U-Net yakashanda zvakananga pamasampureti akaomeswa, ayo akachengetedza ruzivo rwechikamu icho nzira dze spectrogram dzinowanzorasikirwa. Iyo yakashandiswa zvakanyanya Hybrid Demucs uye gare gare Hybrid Transformer Demucs (HT-Demucs) process odhiyo mune ese ari maviri waveform uye spectrogram domains panguva imwe chete, wobva waasanganisa, uye wedzera muchinjiko-domain transformer kutarisisa kuenzanisira kureba kwechimiro. Akadzidziswa paMUSDB18 dataset pamwe nekuwedzera data, maDemucs anopatsanura musanganiswa kuita mana madzinde (manzwi, zvigubhu, bass, zvimwe) uye yave chishandiso chakasarudzika nekuti yakavhurika sosi, inomhanya pavatengi maGPU, uye inogara ichiverengera padyo nepamusoro pamabhenji ekuparadzanisa.
Technical Insight
Hybrid Demucs inomhanya maviri akafanana encoder-decoder matavi: imwe pane yenguva-domain waveform uye imwe pane STFT spectrogram. Zvimiro zvinotsinhaniswa pakati pematavi uye zvakasanganiswa, saka modhi inoshandisa iyo chaiyo chikamu cheiyo waveform uye yakajeka frequency chimiro cheiyo spectrogram. Hunhu hunoyerwa neSignal-to-Distortion Ratio (SDR) mumadecibel panziyo dzakabatirirwa. Musiyano wetransformer unowedzera wega- uye kuyambuka-kutarisisa kutora mamiriro emimhanzi mumasekonzi.
Strategic Impact
Svika uye svika
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
Mutengo uye bhajeti
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
Kumhanya uye chiyero
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.
Ramangwana reDemucs uye HT-Demucs Music Source Separation
Kupatsanurwa kuri kuenda kune mamwe madzinde (kuparadzanisa magitare ega, pianos, kana kunyange vaimbi chaivo), chaiyo-nguva uye-pa-mudziyo mashandiro, uye kupatsanurwa kwemavara ("kuparadzanisa saxophone"). Mamodheru arinani anozodzikisa zvinhu zvine mvura zvichiri kuoneka pamisanganiswa yakakora. Sezvo hunhu huchikwira, tarisira kubatanidzwa kwakadzama muDAWs, karaoke uye remix maapplication, uye maturusi ekudzidzisa mimhanzi, pamwe nekupokana kuri kuramba kuchiitika pamusoro pekodzero uye mvumo yekubvisa zvakachena chero inzwi remuimbi.
Real-World Implementation
Vagadziri uye remixer vanotora yakachena acapellas kana zviridzwa kubva mumateki akaburitswa
Karaoke apps inobvisa lead vocals panhunzi kuti igadzire makwara ekutsigira
Vaimbi vanoparadzanisa bassline kana chigubhu groove kunyora kana kudzidzira pamwe chete
Audio kudzoreredza uye sampling workflows inoda kusimudza chiridzwa chimwe kubva mumusanganiswa wekare
Njodzi & Guardrails
Kushandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.
Implementation Roadmap
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Demucs and HT-Demucs Music Source Separation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Open-Unmix Music Separation
Mibvunzo inowanzo bvunzwa
What is Demucs and HT-Demucs Music Source Separation?
Demucs i Meta's open-source music source separation model; Hybrid Transformer Demucs (HT-Demucs) inotsemura nziyo kuita inzwi, chigubhu, bass, uye mamwe madzinde uchishandisa waveform uye spectrogram kugadzirisa.
Ko Demucs anoita sei kune rwiyo rwakapera?
Demucs inoita mimhanzi kupatsanurwa kwemimhanzi, kupatsanura musanganiswa we stereo kuita chiridzwa chega uye madzinde ezwi.
Chii chinoita kuti Hybrid Demucs 'hybrid'?
Hybrid Demucs inosanganisa nguva-domain waveform bazi uye spectrogram bazi, kusanganisa masimba avo.
Ndeipi metric inowanzoshandiswa kuongorora kunaka kwekuparadzaniswa?
SDR, yakayerwa mumadecibel, inotara kuti hunde yakafungidzirwa inoenderana zvakachena sei nekwakabva.
Nderipi sangano rakaburitsa Demucs pakutanga?
Demucs yakagadzirwa uye yakavhurwa-yakavhurwa nevaongorori pa Meta AI / FAIR.
Sei maDemucs ekutanga akashanda zvakananga pane yakaomeswa waveform?
Kushanda mune waveform domain inochengetedza chikamu, iyo spectrogram-magnitude nzira dzinowanzorasa uye dzinofanirwa kufungidzira.