I-Demucs kanye ne-HT-Demucs Music Source Separation
I-Demucs iyimodeli ye-Meta yokuhlukanisa umthombo womculo ovulekile; I-Hybrid Transformer Demucs (HT-Demucs) ihlukanisa izingoma zibe izwi, isigubhu, ibhesi, nezinye iziqu kusetshenziswa i-waveform kanye ne-spectrogram processing.
I-Deep Dive
Ama-Demucs (I-Deep Extractor Yemithombo Yomculo) ibhekana nenkinga yakudala "yokungaxubani": ukubuyisela amathrekhi ensimbi ngayinye ekurekhodweni kokugcina kwesitiriyo. Izinguqulo zangaphambili zasebenzisa isizinda se-waveform-U-Net esisebenze ngokuqondile kumasampuli omsindo angahluziwe, agcine ulwazi lwesigaba oluvame ukulahleka izindlela ze-spectrogram. Ama-Hybrid Demucs asetshenziswa kabanzi kanye ne-Hybrid Transformer Demucs yakamuva (HT-Demucs) acubungula umsindo kuzo zombili izizinda ze-waveform ne-spectrogram ngasikhathi sinye, bese uwahlanganisa, bese wengeza ukunakwa kwe-transformer yesizinda esiphambanayo kumodeli yesakhiwo sebanga elide. Iqeqeshwe kudathasethi ye-MUSDB18 kanye nedatha eyengeziwe, ama-Demucs ahlukanisa ingxube ibe yiziqu ezine (izwi, izigubhu, i-bass, nokunye) futhi isibe yithuluzi elizenzakalelayo ngenxa yokuthi iwumthombo ovulekile, isebenza kuma-GPU abathengi, futhi ithola amaphuzu ngokungaguquki eduze kwaphezulu kumabhentshimakhi okuhlukanisa.
I-Technical Insight
Ama-Hybrid Demucs asebenzisa amagatsha amabili ahambisanayo e-encoder-decoder: elilodwa ku-waveform yesizinda sesikhathi nelinye ku-spectrogram ye-STFT. Izici zishintshaniswa phakathi kwamagatsha futhi zihlanganisiwe, ngakho imodeli isebenzisa isigaba esinembile se-waveform kanye nesakhiwo esicacile semvamisa ye-spectrogram. Ikhwalithi ikalwa nge-Signal-to-Distortion Ratio (SDR) ngamadecibel ezingomeni ezibanjiwe. Ukwehluka kwe-transformer kungeza ukuzinaka nokuzinaka ukuze kuthwebule umongo womculo imizuzwana.
I-Strategic Impact
Finyelela futhi ufinyelele
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Izindleko kanye nesabelomali
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Isivinini nesikali
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Ikusasa LamaDemu kanye Nokwehlukaniswa Komthombo Womculo we-HT-Demucs
Ukuhlukaniswa komthombo kuqhubekela kuziqu ezengeziwe (ukuhlukanisa iziginci ngazinye, amapiyano, noma ngisho abaculi abathile), ukusebenza kwesikhathi sangempela nokusedivayisini, kanye nokwehlukana okulethwa umlayezo wombhalo ("hlukanisa i-saxophone"). Amamodeli angcono azonciphisa ama-artifact anamanzi asavela kumamiksi aminyene. Njengoba ikhwalithi ikhuphuka, lindela ukuhlanganiswa okujulile kuma-DAW, izinhlelo zokusebenza ze-karaoke ne-remix, namathuluzi okufundisa umculo, kanye nenkulumompikiswano eqhubekayo mayelana nemithelela ye-copyright nemvume yokukhipha ngokuhlanzekile iphimbo elingalodwa lanoma yimuphi umculi.
Ukuqaliswa Komhlaba Wangempela
Abakhiqizi nama-remix akhipha ama-acapella ahlanzekile noma izinsimbi kumathrekhi akhishiwe
Izinhlelo zokusebenza ze-Karaoke zisusa amazwi okuhola ngokuhamba kwesikhathi ukuze zenze amathrekhi asekelayo
Abaculi abahlukanisa i-bassline noma i-drum groove abazoyibhala noma bazilolonge kanye nayo
Ukubuyiselwa komsindo nokugeleza kokusebenza kwesampula okudinga ukuphakamisa insimbi eyodwa ekuxubeni endala
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Demucs and HT-Demucs Music Source Separation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukwehlukana Komculo Ovulekile-Unmix
Imibuzo evame ukubuzwa
What is Demucs and HT-Demucs Music Source Separation?
I-Demucs iyimodeli ye-Meta yokuhlukanisa umthombo womculo ovulekile; I-Hybrid Transformer Demucs (HT-Demucs) ihlukanisa izingoma zibe izwi, isigubhu, ibhesi, nezinye iziqu kusetshenziswa i-waveform kanye ne-spectrogram processing.
Wenzani uDemucs engomeni eqediwe?
I-Demucs yenza ukuhlukaniswa komthombo womculo, ihlukanise ingxube ye-stereo ibe insimbi ngayinye neziqu zezwi.
Yini eyenza i-Hybrid Demucs ibe 'hybrid'?
Ama-Hybrid Demucs ahlanganisa igatsha le-waveform yesizinda sesikhathi kanye negatsha le-spectrogram, ahlanganisa amandla awo.
Iyiphi imethrikhi evame ukusetshenziswa ukuze kuhlolwe ikhwalithi yokuhlukaniswa?
I-SDR, ikalwa ngama-decibel, ilinganisa ukuthi isiqu esilinganiselwe sifana ngokuhlanzeka kangakanani nomthombo wangempela.
Iyiphi inhlangano ekhiphe amaDemucs ekuqaleni?
Ama-Demucs athuthukiswe futhi avuleleka ngabacwaningi ku-Meta AI / FAIR.
Kungani ama-Demucs akuqala asebenza ngokuqondile ku-waveform eluhlaza?
Ukusebenza kusizinda se-waveform kugcina isigaba, okuyizindlela zobukhulu be-spectrogram ezivame ukusilahla futhi okufanele zilinganise.