Uhlolojikelele
I-Open-Unmix (UMX) iyisistimu yokufunda ejulile enomthombo ovulekile ehlukanisa ingoma ibe izingxenye zayo: amazwi, izigubhu, i-bass, nezinye izinsimbi. Ibalulekile njengesisekelo esingakhiqizeka kabusha, sekhwalithi yereferensi esenze ukuhlukaniswa komthombo womculo kufinyeleleke kubacwaningi, abaculi, nabazithandayo.
I-Open-Unmix Music Separation ihlala ku-audio-AI workflows eguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.
I-Deep Dive
Ikhishwe ngo-2019 ngu-Stoter, Uhlich, Liutkus, kanye ne-Mitsufuji, i-Open-Unmix yakhiwe ngamabomu njengesisekelo esisobala, esibhalwe kahle ku-PyTorch (enechweba le-TensorFlow ne-NNabla). Iqeqesha imodeli eyodwa ngesiqu sethagethi ku-spectrogram yobukhulu bengxube. Umnyombo uyi-LSTM enezingqimba ezintathu ehlanganiswe izendlalelo ezixhumeke ngokugcwele, ebikezela imaski ye-spectral yomthombo oqondiwe. Ngenxa yokuthi isebenza ngobukhulu, iphinda isebenzise isigaba sengxube futhi yakha kabusha isiqu nge-STFT ephambene, ngokuzikhethela icwengisiswe ngesihlungi se-Wiener esineziteshi eziningi. Uqeqeshwe kudathasethi ye-MUSDB18 evulekile, ayijahi izikolo eziphezulu zebhodi yabaphambili; umgomo wayo ukucaca nokukhiqiza kabusha, okunikeza umphakathi iphuzu elinokwethenjelwa lokuqhathanisa nesisekelo sokwakhela phezu kwaso.
I-Technical Insight
Isiqu ngasinye sinenethiwekhi yaso esebenza ku-spectrogram ye-magnitude. Imigqomo yefrikhwensi imisiwe futhi inobukhulu-yehliswa ungqimba oluminyene, i-LSTM eqondiwe kabili ithwebula umongo wesikhashana kuzo zombili izinkomba, futhi izendlalelo ezengeziwe eziminyene zinwebeka zibuyele ekulungisweni okugcwele kwefrikhwensi ukuze kukhiqizwe imaski ethambile. Ukuphindaphinda imaski ngobukhulu bengxube kuveza umthombo olinganiselwe; isigaba sokuqala siphinde sisetshenziswe, futhi isihlungi se-Wiener singacwengisa ngokuhlanganyela zonke iziqu ngemiphumela ehlanzekile.
Ukuba ingcweti kwe-Open-Unmix Music Separation
I-Open-Unmix (UMX) iyisistimu yokufunda ejulile enomthombo ovulekile ehlukanisa ingoma ibe izingxenye zayo: amazwi, izigubhu, i-bass, nezinye izinsimbi. Ibalulekile njengesisekelo esingakhiqizeka kabusha, sekhwalithi yereferensi esenze ukuhlukaniswa komthombo womculo kufinyeleleke kubacwaningi, abaculi, nabazithandayo. I-Open-Unmix Music Separation ihlala ku-audio-AI workflows eguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-Open-Unmix Music Separation njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa i-Open-Unmix Music Separation aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthumela. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ikhipha ithrekhi yezwi engayodwa ukuze wenze i-karaoke noma inguqulo yezinsimbi zengoma.
Ukukhipha iziqu zesigubhu noma ze-bass ukuze kuxutshwe kabusha futhi kuthathwe amasampula ngabakhiqizi.
Isebenza njengesisekelo socwaningo esingakhiqizeka kabusha sokuhlola amamodeli amasha okuhlukanisa ku-MUSDB18.
Ukuvumela abafundi bomculo ukuba bahlukanise insimbi eyodwa ukuze bafunde ingxenye yayo emiksini.
Amaphethini Okusebenzisa
Ukwehlukaniswa komculo we-Open-Unmix kuyasebenza
Ikhipha ithrekhi yezwi engayodwa ukuze wenze i-karaoke noma inguqulo yezinsimbi zengoma.
Ukukhipha iculo elikhethekile ukuze kwenziwe i-karaoke noma inguqulo yezinsimbi zengoma Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukwehlukaniswa komculo we-Open-Unmix kuyasebenza
Ukukhipha iziqu zesigubhu noma ze-bass ukuze kuxutshwe kabusha futhi kuthathwe amasampula ngabakhiqizi.
Ukukhipha iziqu zesigubhu noma ze-bass ukuze kuxutshwe kabusha futhi kuthathwe amasampula ngabakhiqizi Amathimba ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukwehlukaniswa komculo we-Open-Unmix kuyasebenza
Isebenza njengesisekelo socwaningo esingakhiqizeka kabusha sokuhlola amamodeli amasha okuhlukanisa ku-MUSDB18.
Ukusebenzela njengesisekelo socwaningo esingakhiqizeka kabusha sokuhlola amamodeli amasha okuhlukanisa KumaQembu e-MUSDB18 ngokuvamile athola imiphumela engcono lapho echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamacala asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukwehlukaniswa komculo we-Open-Unmix kuyasebenza
Ukuvumela abafundi bomculo ukuba bahlukanise insimbi eyodwa ukuze bafunde ingxenye yayo emiksini.
Ukuvumela abafundi bomculo bahlukanise insimbi eyodwa ukuze bafunde ingxenye yayo kungxubevange Amaqembu ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, agcine indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.