Audio AI JAGORA

Demucs da HT-Demucs Rabuwar Tushen Kiɗa

Demucs shine Meta's buɗaɗɗen tushen kiɗan rarrabuwar tushen kiɗan; Hybrid Transformer Demucs (HT-Demucs) yana raba waƙoƙi zuwa murya, ganga, bass, da sauran mai tushe ta amfani da tsarin motsi da sarrafa sikirin.

2 min karatuAn sabunta ta ƙarshe

Zurfafa nutsewa

Demucs (Deep Extractor for Music Sources) yana magance matsalar "un-mixing" na yau da kullun: dawo da waƙoƙin kayan aiki guda ɗaya daga rikodin sitiriyo na ƙarshe. Siffofin farko sun yi amfani da yankin U-Net na igiyar igiyar ruwa wanda ke aiki kai tsaye akan samfuran sauti masu inganci, waɗanda ke adana bayanan lokaci waɗanda hanyoyin sifofi sukan rasa. Hybrid Demucs da aka yi amfani da su da yawa kuma daga baya Hybrid Transformer Demucs (HT-Demucs) suna aiwatar da sauti a cikin nau'ikan waveform da spectrogram a lokaci guda, sannan a haɗa su, kuma suna ƙara kulawar taswirar yanki zuwa ƙirar tsari mai tsayi. An horar da su akan tsarin bayanan MUSDB18 da ƙarin bayanai, Demucs yana raba mahaɗa zuwa mai tushe guda huɗu (vocals, ganguna, bass, wasu) kuma ya zama kayan aiki na asali saboda buɗaɗɗen tushe, yana gudana akan GPUs masu amfani, kuma koyaushe yana ƙima kusa da saman akan alamomin rabuwa.

Fahimtar Fasaha

Hybrid Demucs runs two parallel encoder-decoder branches: one on the time-domain waveform and one on the STFT spectrogram. Ana musayar fasali tsakanin rassan da haɗin gwiwa, don haka samfurin yana amfani da daidaitaccen lokaci na waveform da ingantaccen tsarin mitar sifili. Quality is measured with Signal-to-Distortion Ratio (SDR) in decibels on held-out songs. The transformer variant adds self- and cross-attention to capture musical context across seconds.

Dabarun Tasiri

Shiga ku isa

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.

Kudin da kasafin kuɗi

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.

Gudu da sikelin

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.

Makomar Demucs da HT-Demucs Maɓallin Waƙar Rabewa

Rabuwar tushen yana motsawa zuwa ƙarin mai tushe (raba guitars guda ɗaya, pianos, ko ma takamaiman mawaƙa), aiki na ainihi da na'ura, da rabuwa mai saurin rubutu ("keɓe saxophone"). Better models will reduce the watery artifacts that still appear on dense mixes. Yayin da inganci ya hauhawa, tsammanin zurfafa haɗawa cikin DAWs, karaoke da remix apps, da kayan aikin ilimin kiɗa, tare da muhawara mai gudana game da haƙƙin mallaka da yarda da abubuwan da ke tattare da tsaftataccen cire kowane muryar mai fasaha.

Aiwatar da Gaskiyar Duniya

Furodusa da remixers suna fitar da tsaftataccen acapellas ko kayan aiki daga waƙoƙin da aka saki

Karaoke apps suna cire muryoyin gubar akan tashi don ƙirƙirar waƙoƙin goyan baya

Mawakan keɓe bassline ko ganga don rubutawa ko aiki tare

Maido da sauti da kuma samar da ayyukan aiki waɗanda ke buƙatar ɗaga kayan aiki ɗaya daga tsohuwar haɗakarwa

Hatsari & Tsare-tsare

Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.

Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.

Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.

Taswirar Hanya

1

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.

2

Gwajin ingantattun masu magana daban-daban da yanayin baya.

3

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.

4

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.

Ci gaba da Bincike

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Demucs and HT-Demucs Music Source Separation quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Fara tambayoyi

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Jagora na gaba

Buɗe-Unmix Rabewar Kiɗa

Tambayoyin da ake yawan yi

What is Demucs and HT-Demucs Music Source Separation?

Demucs shine Meta's buɗaɗɗen tushen kiɗan rarrabuwar tushen kiɗan; Hybrid Transformer Demucs (HT-Demucs) yana raba waƙoƙi zuwa murya, ganga, bass, da sauran mai tushe ta amfani da tsarin motsi da sarrafa sikirin.

Menene Demucs ke yi ga waƙar da aka gama?

Demucs yana yin rarrabuwar tushen kiɗan, yana rarrabuwar haɗaɗɗiyar sitiriyo zuwa kayan aiki ɗaya da sautin murya.

Me yasa Hybrid Demucs 'hybrid'?

Hybrid Demucs yana haɗu da reshen tsarin raƙuman ruwa na lokaci-yanki da reshe na bakan, yana haɗa ƙarfinsu.

Wanne awo ne aka fi amfani dashi don kimanta ingancin rabuwa?

SDR, wanda aka auna a cikin decibels, yana ƙididdige yadda tsaftataccen tushe ya dace da tushen gaskiya.

Wace kungiya ce ta fara fitar da Demucs?

Masu bincike sun ƙirƙira Demucs kuma buɗe-bude-buɗe ta hanyar masu bincike a Meta AI / FAIR.

Me yasa farkon Demucs yayi aiki kai tsaye akan sigar raƙuman ruwa?

Yin aiki a cikin yanayin yanayin igiyar ruwa yana adana lokaci, waɗanda hanyoyin girman-spectrogram sukan watsar kuma dole ne suyi ƙima.