UMHLAHLANDLELA WE-AI womsindo

Ukuhlukaniswa Komthombo Womculo weDemucs

I-Demucs iyimodeli yesimanjemanje yokufunda ejulile evela ku-Meta AI ehlukanisa ingoma eqediwe ibe yiziqu ezihlukene njengamaphimbo, izigubhu, ibhesi, nezinye izinsimbi.

Uhlolojikelele

I-Demucs iyimodeli yesimanjemanje yokufunda ejulile evela ku-Meta AI ehlukanisa ingoma eqediwe ibe yiziqu ezihlukene njengamaphimbo, izigubhu, ibhesi, nezinye izinsimbi. Ivumela noma ubani ukuthi adonse izwi elihlanzekile noma insimbi exutshwe ne-stereo.

I-Demucs Music Source Separation ihlala ekuhambeni komsebenzi okulalelwayo-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.

I-Deep Dive

Ama-Demucs (I-Deep Extractor Yemithombo Yomculo) ibhekana nenkinga yakudala "yokungaxubani": ukubuyisela amathrekhi ensimbi ngayinye ekurekhodweni kokugcina kwesitiriyo. Izinguqulo zangaphambili zasebenzisa isizinda se-waveform-U-Net esisebenze ngokuqondile kumasampuli omsindo angahluziwe, agcine ulwazi lwesigaba oluvame ukulahleka izindlela ze-spectrogram. Ama-Hybrid Demucs asetshenziswa kabanzi kanye ne-Hybrid Transformer Demucs yakamuva (HT-Demucs) acubungula umsindo kuzo zombili izizinda ze-waveform ne-spectrogram ngasikhathi sinye, bese uwahlanganisa, bese wengeza ukunakwa kwe-transformer yesizinda esiphambanayo kumodeli yesakhiwo sebanga elide. Iqeqeshwe kudathasethi ye-MUSDB18 kanye nedatha eyengeziwe, ama-Demucs ahlukanisa ingxube ibe yiziqu ezine (izwi, izigubhu, i-bass, nokunye) futhi isibe yithuluzi elizenzakalelayo ngenxa yokuthi iwumthombo ovulekile, isebenza kuma-GPU abathengi, futhi ithola amaphuzu ngokungaguquki eduze kwaphezulu kumabhentshimakhi okuhlukanisa.

I-Technical Insight

Ama-Hybrid Demucs asebenzisa amagatsha amabili ahambisanayo e-encoder-decoder: elilodwa ku-waveform yesizinda sesikhathi nelinye ku-spectrogram ye-STFT. Izici zishintshaniswa phakathi kwamagatsha futhi zihlanganisiwe, ngakho imodeli isebenzisa isigaba esinembile se-waveform kanye nesakhiwo esicacile semvamisa ye-spectrogram. Ikhwalithi ikalwa nge-Signal-to-Distortion Ratio (SDR) ngamadecibel ezingomeni ezibanjiwe. Ukwehluka kwe-transformer kungeza ukuzinaka nokuzinaka ukuze kuthwebule umongo womculo imizuzwana.

I-Mastering Demucs Music Source Separation

I-Demucs iyimodeli yesimanjemanje yokufunda ejulile evela ku-Meta AI ehlukanisa ingoma eqediwe ibe yiziqu ezihlukene njengamaphimbo, izigubhu, ibhesi, nezinye izinsimbi. Ivumela noma ubani ukuthi adonse izwi elihlanzekile noma insimbi exutshwe ne-stereo. I-Demucs Music Source Separation ihlala ekuhambeni komsebenzi okulalelwayo-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-Demucs Music Source Separation njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa i-Demucs Music Source Separation aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthumela. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Lokuhlukaniswa Komthombo Womculo We-Demucs

Ukuhlukaniswa komthombo kuqhubekela kuziqu ezengeziwe (ukuhlukanisa iziginci ngazinye, amapiyano, noma ngisho abaculi abathile), ukusebenza kwesikhathi sangempela nokusedivayisini, kanye nokwehlukana okulethwa umlayezo wombhalo ("hlukanisa i-saxophone"). Amamodeli angcono azonciphisa ama-artifact anamanzi asavela kumamiksi aminyene. Njengoba ikhwalithi ikhuphuka, lindela ukuhlanganiswa okujulile kuma-DAW, izinhlelo zokusebenza ze-karaoke ne-remix, namathuluzi okufundisa umculo, kanye nenkulumompikiswano eqhubekayo mayelana nemithelela ye-copyright nemvume yokukhipha ngokuhlanzekile iphimbo elingalodwa lanoma yimuphi umculi.

Ukuqaliswa Komhlaba Wangempela

Abakhiqizi nama-remix akhipha ama-acapella ahlanzekile noma izinsimbi kumathrekhi akhishiwe

Izinhlelo zokusebenza ze-Karaoke zisusa amazwi okuhola ngokuhamba kwesikhathi ukuze zenze amathrekhi asekelayo

Abaculi abahlukanisa i-bassline noma i-drum groove abazoyibhala noma bazilolonge kanye nayo

Ukubuyiselwa komsindo nokugeleza kokusebenza kwesampula okudinga ukuphakamisa insimbi eyodwa ekuxubeni endala

Amaphethini Okusebenzisa

I-Demucs Music Source Separation in practice

Abakhiqizi nama-remix akhipha ama-acapella ahlanzekile noma izinsimbi kumathrekhi akhishiwe.

Abakhiqizi nama-remix akhipha ama-acapella ahlanzekile noma izinsimbi kumathrekhi akhishiwe Amathimba ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Demucs Music Source Separation in practice

Izinhlelo zokusebenza ze-Karaoke zisusa amazwi okuhola ngokuhamba kwesikhathi ukuze zenze amathrekhi asekelayo.

Izinhlelo zokusebenza ze-Karaoke zisusa amazwi okuhola undiza ukuze enze amathrekhi asekelayo Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Demucs Music Source Separation in practice

Abaculi abahlukanisa i-bassline noma i-drum groove abazoyibhala noma bazilolonge kanye nayo.

Abaculi abahlukanisa i-bassline noma i-drum groove ukuze balobe noma bazilolonge kanye namaQembu ngokuvamile bathola imiphumela engcono lapho bechaza izinga eliphezulu ngaphambili, begcina indlela yokukhuphuka kwabantu yamakesi asematheni, futhi balandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Demucs Music Source Separation in practice

Ukubuyiselwa komsindo nokugeleza kokusebenza kwesampula okudinga ukuphakamisa insimbi eyodwa ekuxubeni endala.

Ukubuyiselwa komsindo nokugeleza kokusebenza kwesampula okudinga ukuphakamisa ithuluzi elilodwa kunhlanganisela endala Amathimba ngokuvamile athola imiphumela engcono lapho echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

!

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

!

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole