GUIDE IA Audio

Demucs ak HT-Demucs tàqale xët

Demucs is Meta's open-source music source separation model; Hybrid Transformer Demucs (HT-Demucs) splits songs into vocal, drum, bass, and other stems using waveform and spectrogram processing.

2 simili jàngDañu mujjee yeesal

Plongeur bu xóot

Demucs (Extracteur bu xóot ngir Sources Music) dafay xeex jafe-jafe "un-mixing" bu yàgg bi: defaraat benn-benn piyeesu jumtukaay ci enregistrement stéréo bu mujj. Version yu njëkk ya dañu daan jëfandikoo U-Net bu am formu onde bu daan liggéey ci misaali audio yu ñor, loolu mooy denc leerali fase yi spectrogram yi di faral di ñàkk. Demucs Hybrid yi ñu gëna jëfandikoo ak Demucs Transformer Hybrid yi (HT-Demucs) dañuy jëfandikoo audio ci domaine onde ak spectrogram yépp benn yoon, ba noppi boole leen, ba noppi yokk ci transformateur domaine yu bari ngir model structure bu sori. Demucs dafa tàggat ci MUSDB18 dataset ak yeneen done, Demucs dafay tàqale njaxas ci ñeenti stem (vocals, drums, bass, leneen) ba noppi nekk jumtukaay bu ñuy jëfandikoo ndax source open la, dafay daw ci GPUs konsomatër, te dafay gëna jege kaw ci benchmarks tàqale.

Gis-gis xarala

Hybrid Demucs dafa am ñaari car encodeur-decodeur yu paralel: benn ci formu onde domaine temps ak beneen ci spectrogram STFT. Man-man yi dañuy weccoo ci diggante car yi ak boole, suko defee model bi di jëfandikoo fase bu dëggu bi ci forme vague bi ak structure fréquence bu leer ci spectrogram bi. Kalite bi ñu ngi koy natt ci ratio siñaal-ci-distorsion (SDR) ci desibel ci way yuñ tëye. Xeetu transformatër bi dafay yokk xel ci sa bopp ak ci jàkkarloo ngir jàpp contexte musical ci ay segond.

njeextalu pexe

Dugg ak yegg

Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.

Njëgg ak budget

Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.

Gaawaay ak yaatuwaay

Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.

Ëlëgu Demucs ak HT-Demucs tàqale fi ñuy bawoo ci music

Tàqale source mingi dem ci stem yu bari (tàqale gitaar yi, piano yi, wala sax waykat yu benn-benn), liggéey ci jamono dëgg ak ci aparey bi, ak tàqale bi ñuy laaj ci bind ("tàqale saxophone bi"). Modèle yu gëna baax dina ñu wàññi artefact ndoxe yi ba leegi di feeñ ci njaxas yu dëgër yi. Lu kalite bi di yokk, xaarandil lëkkaloo bu gëna xóot ci DAWs, karaoke ak remix apps, ak jumtukaayi jàngale music, ci wetu waxtaan buy wéy ci yelleefu moomeel ak ndigalu génne bu sell ci bépp artist bu amul kàddu.

Doxal ci àdduna dëgg

Producteur yi ak remixer yi di génne acapella yu sell wala instrumental ci track yiñ génne

Aplikaasioŋu karaoke yi dañuy dindi kàddu yu mag yi ci saa si ngir sos way yu ci topp

Waykat yi dañuy tànn liiñ bass wala groove drum ngir mëna bind wala di tàggat sa bopp

Restaurasioŋ audio ak sampling workflows yi wara génne benn jumtukaay ci mix bu yàgg

Risk yi ak balustrade yi

Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.

Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.

Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.

Roadmap ngir samp gi

1

Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.

2

Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.

3

Mandargal kañ la nit wara xoolaat wala nangu ay génne.

4

Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.

Weyal di banneexu

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Demucs and HT-Demucs Music Source Separation quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tambalil quiz

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Gis bi ci topp

Tàqale Musik Open-Unmix

Laaj yi ñuy faral di laaj

What is Demucs and HT-Demucs Music Source Separation?

Demucs is Meta's open-source music source separation model; Hybrid Transformer Demucs (HT-Demucs) splits songs into vocal, drum, bass, and other stems using waveform and spectrogram processing.

Lu Demucs di def ci way wu jeex?

Demucs dafay tàqale balluwaayi music bi, xaaj njaxasu stéréo ci jumtukaay bu nekk ak stem vocal.

Lan mooy tax Demucs Hybrid 'hibrid'?

Demucs hybrid yi dañu boole bànxaasu onde bu domaine temps ak bànxaasu spectrogram, boole seeni doole.

Ban metric lañuy faral di jëfandikoo ngir jàngat kalite tàqale bi?

SDR, ñu koy natt ci desibel, mooy wane ni petal biñ xayma méngoo ak balluwaay bi dëgg.

Ban mbootaay moo njëkka génne Demucs?

Demucs was developed and open-sourced by researchers at Meta AI / FAIR.

Lu tax Demucs yu njëkk ya liggéey ci forme onde bu ñor?

Liggéey ci domaine forme onde dafay denc fase, bi pexe magnitude spectrogram yi di faral di sànni te dañu ko wara xayma.