DDSP Synthesis ọdịyo dị iche
DDSP (Differentiable Digital Signal Processing) na-eji netwọk akwara jikọtara ihe mgbochi synthesizer kpochapụwo, yabụ mmụta miri emi nwere ike ijikwa oscillators na nzacha ozugbo.
Nchịkọta
It produces strikingly natural, controllable instrument sounds with tiny models and little data.
Ime miri emi
DDSP, nke ndị otu Magenta Google webatara na 2020, na-echegharịgharị ọgbọ ọdịyo akwara. Kama netwọk na-ebu amụma ihe nlele ọdịyo raw otu n'otu oge (dị ka WaveNet) ma ọ bụ pikselụ nke spectrogram, DDSP na-eme ihe DSP ọdịnala - ihe mgbakwunye oscillator na-emekọ ihe, onye na-emepụta ụda mkpọtụ, na reverb - dị iche. Nke ahụ pụtara na gradients nwere ike na-agafe na ha n'oge ọzụzụ, yabụ obere netwọkụ akwara na-amụta imepụta akara njikwa nwere ike ịkọwa: ụda isi, ụda n'ozuzu ya na njupụta nke ọtụtụ ihe kwekọrọ n'oge. A synthesizer wee sụgharịa n'ezie audio si na ndị a. N'ihi na a na-etinye physics nke ụda n'ime ihe owuwu kama ịmụta site na ọkọ, DDSP na-enweta ogo dị elu na obere parampat na ihe atụ ọzụzụ, ma na-ahapụ ndị ọrụ aka ịchịkwa ụda, ụda olu na timbre - ọbụna na-ebufe timbre, dị ka ịme ụda olu dị ka violin.
Nghọta nka nka
Ihe bụ isi bụ ihe nrụpụta ihe nlere anya dị iche iche: ụlọ akụ oscillator na-emekọ ihe na-ewepụta nchikota nke ebili mmiri sine na ọnụọgụ ọnụọgụ nke ugboro dị mkpa, ebe ụzọ dị iche na-enyocha mkpọtụ ọcha maka iku ume na textures inharmonic. Netwọk akwara anaghị ewepụta ụda ozugbo - ọ na-ewepụta usoro njikwa oge na-agbanwe agbanwe (f0, ụda olu, nkesa kwekọrọ, ọnụọgụ nzacha). Ọzụzụ na-eji mfu spectrogram dị ọtụtụ atụnyere ọdịyo ewepụtara na ebumnuche gafere n'ọtụtụ windo FFT, nke siri ike ruo n'iche dị n'usoro.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke Synthesis Audio dị iche iche DDSP
DDSP na-akwalite ngwa akwara ozi dị ala na mmetụta ọdịyo na-arụ ọrụ na ngwaike dị obere, gụnyere ihe nchọgharị na na ngwaọrụ agbakwunyere. Njikwa ntụgharị ya na-eme ka ọ dị mma maka ngwa ọrụ ngosipụta na ngwakọ synthesizer ebe ndị egwu na-akpọ timbre ozugbo. Ndị na-eme nchọpụta na-agbatị echiche dị iche iche-DSP na nhazi anụ ahụ, ihe nkiri ọnụ ụlọ, na ụdọ mmepụta ọdịyo zuru oke, na-ejikọta njikwa njikwa nke nhazi akara ngosi na eziokwu nke mmụta miri emi n'ofe egwu egwu na imepụta ụda.
Mmejuputa n'ezie n'ụwa
Ngwa mbufe timbre nke na-ewere egwu kụdara ma ọ bụ bụrụ abụ wee tụgharịa ya ka violin, ọjà ma ọ bụ opi ozugbo.
Ihe mgbakwunye akwara akwara dị fechaa nke ndị na-egwu egwu na-ejikwa n'ọkwa ụda mmetụta, ụda olu na nchapụta.
Ndozi-nzizi na nkwuputa resynthesis nke ngwa edekọtara ka ọ na-echekwa nkọwa nkwekọ nke okike.
Ngosi egwu mmekọrịta dabere na ihe nchọgharị na-emepụta ụda akụrụngwa na-enweghị ụdị GPU dị arọ.
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DDSP Differentiable Audio Synthesis quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nchịkọta AudioGen Ederede-gaa-Audio
Ajụjụ a na-ajụkarị
What is DDSP Differentiable Audio Synthesis?
DDSP (Differentiable Digital Signal Processing) na-eji netwọk akwara jikọtara ihe mgbochi synthesizer kpochapụwo, yabụ mmụta miri emi nwere ike ijikwa oscillators na nzacha ozugbo. Ọ na-emepụta ụda akụrụngwa na-enweghị atụ nke nwere obere ụdị yana obere data.
Gịnị bụ isi ihe ọhụrụ n'azụ DDSP?
DDSP na-atụgharị ihe mgbochi ụlọ synthesizer ọdịnala ka ọ bụrụ modul dị iche iche, na-ahapụ netwọkụ akwara ka ọ mụta ịchịkwa ha site na ịgbasa azụ.
Na DDSP, kedu ihe netwọk akwara na-arụpụta n'ezie?
Netwọk ahụ na-ebu amụma usoro njikwa oge na-agbanwe agbanwe, yana synthesizer dị iche iche na-eme ka ọdịyo ahụ si na ha pụta - ọ dịghị ewepụta ihe nlele ozugbo.
Kedu ihe abụọ bụ isi na-emepụta ụda ka DDSP's spectral synthesizer jikọtara?
Ihe mgbakwunye oscillator na-emekọ ihe na-emepụta akụkụ ahụ gbanyere mkpọrọgwụ, nke kwekọrọ ebe mkpọtụ akọrọ na-agbakwunye ume na udidi na-adịghị mma.
Kedu ihe kpatara DDSP nwere ike iji nweta ụdị dị nta na obere data?
N'ihi na arụnyere usoro nrụzi mgbaama ama ama kama ịmụta site na ọkọ, netwọk nwere obere ihe ịmụta, na-emeziwanye data na arụmọrụ oke.
Kedu ọrụ mfu ka DDSP na-eji atụnyere ọdịyo emepụtara na lekwasịrị anya nke ọma?
Ntụle spectrogram dị ukwuu n'ọtụtụ mkpebi siri ike na ndịiche nke usoro, nke mfu-ọkwa na-alụ ọgụ.