Ntuziaka Audio AI

Nkewa isi iyi egwu Demucs na HT-Demucs

Demucs bụ ụdị nkewa isi iyi egwu Meta; Hybrid Transformer Demucs (HT-Demucs) na-ekewa egwu n'ime ụda olu, drum, bass, na ndị ọzọ site na iji waveform na nhazi spectrogram.

2 nkeji na-agụEmelitere ikpeazụ

Ime miri emi

Demucs (Deep Extractor for Music Sources) na-edozi nsogbu "un-mixing" kpochapụrụ: na-eweghachi egwu egwu nke ọ bụla na ndekọ stereo ikpeazụ. Ụdị nke mbụ jiri ngalaba U-Net nke na-arụ ọrụ ozugbo na ntanetị ọdịyo, nke chekwaa ozi nke oge nke usoro spectrogram na-efunahụkarị. Ngwakọta Demucs nke a na-ejikarị eme ihe na mgbe e mesịrị Hybrid Transformer Demucs (HT-Demucs) na-ahazi ọdịyo na mpaghara waveform na spectrogram n'otu oge, wee jikọta ha, ma gbakwunye nleba anya ntụgharị mpaghara na-eme ka usoro nhazi dị ogologo. Zụrụ ya na MUSDB18 dataset yana mgbakwunye data, Demucs na-ekewa ngwakọta n'ime mkpịsị anọ (olu, drum, bass, ndị ọzọ) wee bụrụ ngwaọrụ ndabara n'ihi na ọ bụ isi mmalite, na-agba ọsọ na GPU ndị ahịa, na-agbadata n'akụkụ elu na akara nkewa.

Nghọta nka nka

Hybrid Demucs na-agba alaka abụọ yiri koodu-decoder: otu na oge-ngalaba ebili mmiri na otu na STFT spectrogram. A na-agbanwe atụmatụ n'etiti alaka ma jikọta ya, ya mere, ihe nlereanya ahụ na-eji usoro ziri ezi nke waveform na nhazi oge doro anya nke spectrogram. A na-atụle ogo ya na nha Signal-to-Distortion Ratio (SDR) na decibels na egwu ewepụrụ. Ọdịiche nke ngbanwe na-agbakwunye nleba anya onwe na nleba anya iji weghara ọnọdụ egwu n'ofe sekọnd.

Mmetụta atụmatụ

Nweta na iru

Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.

Ọnụ ego na mmefu ego

Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.

Ọsọ na ọnụ ọgụgụ

Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.

Ọdịnihu nke Demucs na HT-Demucs nkewa isi iyi egwu

Nkewa isi iyi na-aga n'ihu n'ụkwụ ndị ọzọ (na-ekewa guitars onye ọ bụla, pianos, ma ọ bụ ọbụna ndị na-abụ abụ kpọmkwem), arụ ọrụ ozugbo na n'ime ngwaọrụ, yana nkewa nwere ike ime ederede ("kewapụ saxophone"). Ụdị dị mma ga-ebelata ihe ndị na-emepụta mmiri nke ka na-apụta na nnukwu ngwakọta. Ka ịdịmma na-arị elu, na-atụ anya ntinye miri emi na DAWs, karaoke na remix ngwa, yana ngwa nkuzi egwu, yana arụmụka na-aga n'ihu gbasara ikike nwebisiinka na nkwenye nke iwepụta ụda olu ọ bụla dịpụrụ adịpụ nke ọma.

Mmejuputa n'ezie n'ụwa

Ndị na-emepụta ihe na ndị na-emegharị ihe na-ewepụta acapellas ma ọ bụ ngwá ọrụ dị ọcha site na egwu ewepụtara

Ngwa Karaoke na-ewepụ ụda ndu na-efegharị iji mepụta egwu nkwado

Ndị na-egwu egwu na-ekewapụ bassline ma ọ bụ drum groove iji degharịa ma ọ bụ mee ya

Mweghachi nke ọdịyo na nleba anya na-arụ ọrụ nke kwesịrị ibuli otu ngwa n'ime ngwakọta ochie

Ihe ize ndụ & okporo ụzọ nche

Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.

Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.

Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.

Map mmejuputa

1

Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.

2

Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.

3

Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.

4

Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.

Nọgide na-eme nchọpụta

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Demucs and HT-Demucs Music Source Separation quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Malite ajụjụ

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ntuziaka na-esote

Mepee-Unmix Music Nkewa

Ajụjụ a na-ajụkarị

What is Demucs and HT-Demucs Music Source Separation?

Demucs bụ ụdị nkewa isi iyi egwu Meta; Hybrid Transformer Demucs (HT-Demucs) na-ekewa egwu n'ime ụda olu, drum, bass, na ndị ọzọ site na iji waveform na nhazi spectrogram.

Kedu ihe Demucs na-eme na egwu emechara?

Demucs na-eme nkewa isi iyi egwu, na-ekewa ngwakọta stereo n'ime ngwa otu na ụda olu.

Kedu ihe na-eme Hybrid Demucs 'ngwakọ'?

Hybrid Demucs na-ejikọta alaka oge-ngalaba ebili mmiri na ngalaba spectrogram, na-ejikọta ike ha.

Kedu metric a na-ejikarị iji nyochaa ogo nkewa?

SDR, nke a tụrụ na decibels, na-akọwapụta etu stem ahụ e mere atụmatụ si kwekọọ na isi mmalite dị ọcha.

Kedu nzukọ wepụtara Demucs na mbụ?

Ndị nyocha mepụtara demucs wee meghee ya na Meta AI / FAIR.

Kedu ihe kpatara Demucs oge mbụ ji rụọ ọrụ ozugbo na ụdị waveform?

Ịrụ ọrụ na ngalaba waveform na-echekwa oge, nke usoro spectrogram-magnitude na-atụfukarị ma ga-eme atụmatụ.