InoteveraGaidhi rinotevera
AudioGen Chinyorwa-kune-Audio Synthesis
AI Yenyaya
Chidzidzo cheAI yeRuzha
DDSP (Differentiable Digital Signal Processing) fuses classic synthesizer kuvaka zvidhinha neural network, saka kudzidza kwakadzama kunogona kudzora oscillator uye mafirita zvakananga.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Iyo inoburitsa zvinoshamisa zvechisikigo, chinodzoreka chiridzwa chinorira nemhando diki uye data diki.
DDSP, yakaunzwa neGoogle's Magenta timu muna 2020, inofunga zvakare nezve neural audio chizvarwa. Panzvimbo yetiweki inofanotaura mbishi odhiyo samples imwe panguva (seWaveNet) kana mapikseli eiyo spectrogram, DDSP inogadzira echinyakare DSP zvikamu - harmonic additive oscillator, jenareta yakasefa, uye reverb - inosiyaniswa. Izvi zvinoreva kuti ma gradients anogona kuyerera nepakati pawo panguva yekudzidziswa, saka diki neural network inodzidza kuburitsa zvinodudzirwa zvinodzora masiginecha: iyo yakakosha kurira, ruzha rwese, uye amplitudes yeakawanda eharonics nekufamba kwenguva. Synthesizer inobva yapa iwo chaiwo odhiyo kubva kune aya ma control. Nekuti iyo fizikisi yeruzha yakabikwa mukuvaka kwete kudzidzwa kubva pakutanga, DDSP inowana mhando yepamusoro ine mashoma mashoma paramita uye mienzaniso yekudzidzisa, uye inoita kuti vashandisi vazvigadzire kurira, ruzha, uye timbre - kunyangwe kuita kutamisa timbre, sekuita kuti izwi rekuimba ritambe seviolin.
Maturusi ekutamisa maTimbre anotora mutsindo kana wakaimbwa uye oupazve seviolin, nyere, kana hwamanda munguva chaiyo.
Akareruka neural synthesizer plugins anodzorwa nevaimbi nenzwi rinonzwika, ruzha, uye kupenya mapfundo.
Pitch-kururamisa uye inoratidzira resynthesis yezviridzwa zvakarekodhwa uchichengetedza yakasikwa harmonic ruzivo.
Browser-based interactive music demos inogadzira chiridzwa chinonzwika pasina inorema GPU modhi.
DDSP iri kusundira chaiyo-nguva, yakaderera-latency neural zviridzwa uye maodhiyo mhedzisiro inomhanya pane zvine mwero Hardware, kusanganisira mu-browser uye pamidziyo yakamisikidzwa. Zvidzoreso zvaro zvinodudzirwa zvinoita kuti ive yakanaka kune inoratidzira maturusi ekuita uye mahybrid synthesizer uko vaimbi vanofona timbre zvakananga. Vatsvaguri vari kuwedzera iyo inosiyaniswa-DSP zano kune yemuviri modhi, kamuri acoustics, uye yakazara maodhiyo ekugadzira cheni, kusanganisa kudzoreka kwechinyakare chiratidzo chekugadzirisa nehuchokwadi hwekudzidza kwakadzama mukugadzirwa kwemimhanzi uye dhizaini yekurira.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
DDSP (Differentiable Digital Signal Processing) fuses classic synthesizer kuvaka zvidhinha neural network, saka kudzidza kwakadzama kunogona kudzora oscillator uye mafirita zvakananga. Iyo inoburitsa zvinoshamisa zvechisikigo, chinodzoreka chiridzwa chinorira nemhando diki uye data diki.
DDSP inoshandura echinyakare synthesizer zvivharo zvekuvaka kuita anosiyaniswa mamodule, ichirega neural network idzidze kuvadzora kuburikidza nekudzokera shure.
Iyo network inofanotaura nguva-inosiyana-siyana yekudzora ma paramita, uye yakaparadzana inosiyanisa synthesizer inopa odhiyo kubva kwavari - haimbobudise masampuli zvakananga.
Harmonic additive oscillator inogadzira iyo yakadzika, harmonic chikamu apo ruzha rwakasefa runowedzera kufema uye inharmonic magadzirirwo.
Nekuti inozivikanwa chiratidzo-yekugadzirisa chimiro chakavakirwa mukati kwete kudzidza kubva kutanga, network ine zvishoma zvishoma zvekudzidza, kuvandudza data uye parameter kunyatsoita.
Kuenzanisa magnitude spectrograms pakugadziriswa kwakawanda kwakasimba kune chikamu mutsauko, iyo sampuli-level kurasikirwa kunonetsa.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
AudioGen Chinyorwa-kune-Audio Synthesis
AI Yenyaya