Ubuyobozi bwa Audio AI

DDSP Itandukanyirizo ryamajwi

DDSP (Differentiable Digital Signal Processing) ihuza classique ya synthesizer yubaka hamwe nu miyoboro ya neural, bityo kwiga byimbitse birashobora kugenzura oscillator na filtri mu buryo butaziguye.

2 min somaIbiherutse kuvugururwa

Incamake

It produces strikingly natural, controllable instrument sounds with tiny models and little data.

Kwibira cyane

DDSP, yatangijwe nitsinda rya Magenta rya __AIU_PROTECTED_11 __ muri 2020, irongera itekereza kubyara amajwi. Aho kugirango urusobe ruvuga amajwi mbisi ntangarugero icyarimwe (nka WaveNet) cyangwa pigiseli ya spekrogramu, DDSP ikora ibice bya DSP gakondo - oscillator yongerera imbaraga, imashini itanga urusaku, na reverb - bitandukanye. Ibyo bivuze ko gradients zishobora gutembera muri zo mugihe cyamahugurwa, bityo urusobe ruto rwimyumvire rwiga gusohora ibimenyetso bisobanurwa byigenzura: ikibanza cyibanze, urusaku rusange, hamwe na amplitude yimirongo myinshi ihuza igihe. Synthesizer noneho itanga amajwi nyirizina avuye muri ubwo bugenzuzi. Kuberako fiziki yijwi yatetse mubwubatsi aho kwigishwa guhera, DDSP igera kumurongo wo hejuru hamwe nibipimo bike cyane hamwe nurugero rwamahugurwa, kandi ikareka abayikoresha bigenga gukoresha ikibuga, amajwi, na timbre - ndetse no gukora timbre, nko gukora amajwi yo kuririmba acuranga nka gucuranga.

Ubushishozi

Intangiriro ni synthesizer yerekana icyerekezo: banki ihuza oscillator itanga umubare wikigereranyo cya sine kumurongo wuzuye wikigereranyo cyibanze, mugihe inzira itandukanye iyungurura urusaku rwera kugirango uhumeke hamwe nuburyo budahuje. Urusobe rw'imitsi ntirusohora amajwi mu buryo butaziguye - rusohora ibihe bitandukanye byo kugenzura (f0, ijwi ryinshi, gukwirakwiza guhuza, guhuza ibintu). Amahugurwa akoresha igihombo kinini cya spekrogramu ugereranije yakozwe kandi igamije amajwi hejuru yubunini bwa FFT idirishya, rikaba rifite imbaraga zo gutandukana.

Ingaruka z'Ingamba

Kugera no kugera

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Igiciro na bije

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Umuvuduko n'igipimo

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Kazoza ka DDSP Itandukanyirizo ryamajwi

DDSP irimo gusunika igihe-nyacyo, ibikoresho-bitagaragara-byihuta-byuma ningaruka zamajwi bikoresha ibyuma byoroheje, harimo muri-mushakisha ndetse no mubikoresho byashyizwemo. Igenzura ryarwo risobanurwa neza nibyiza kubikoresho byerekana imikorere hamwe na synthesizeri ya Hybrid aho abahanzi bahamagara timbre muburyo butaziguye. Abashakashatsi barimo kwagura igitekerezo gitandukanye-DSP muburyo bwo kwerekana imiterere, acoustics yo mucyumba, hamwe n’iminyururu yuzuye yerekana amajwi, bikavanga uburyo bwo gutunganya ibimenyetso bya kera hamwe n’ukuri ko kwiga byimbitse mu guhanga umuziki no gutunganya amajwi.

Gushyira mu bikorwa Isi

Ibikoresho byo kohereza Timbre bifata injyana yacuranzwe cyangwa yaririmbwe ikongera ikabigaragaza nka violon, umwironge, cyangwa impanda mugihe nyacyo.

Amacomeka yoroheje yoroheje ya synthesizer abacuranzi bagenzura hamwe nijwi ryimbitse, ijwi ryinshi, hamwe nubucyo.

Ikibanza-gikosora hamwe na resynthesis yerekana ibikoresho byafashwe amajwi mugihe uzigama ibintu bisanzwe.

Mucukumbuzi ishingiye kumuziki yerekana imiziki itanga ibikoresho bifatika bidafite imiterere ya GPU iremereye.

Ingaruka & Kurinda

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the DDSP Differentiable Audio Synthesis quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

AudioGen Inyandiko-Kuri-Ijwi

Ibibazo bikunze kubazwa

What is DDSP Differentiable Audio Synthesis?

DDSP (Differentiable Digital Signal Processing) ihuza classique ya synthesizer yubaka hamwe nu miyoboro ya neural, bityo kwiga byimbitse birashobora kugenzura oscillator na filtri mu buryo butaziguye. Itanga ibintu bitangaje bisanzwe, bigenzurwa amajwi hamwe na moderi ntoya hamwe namakuru make.

Ni ubuhe bushya bw'ingenzi inyuma ya DDSP?

DDSP ihindura imyubakire ya synthesizer gakondo muburyo butandukanye, kureka urusobe rw'imitsi rwiga kubigenzura binyuze muri backpropagation.

Muri DDSP, mubyukuri urusobe rw'imitsi rusohora iki?

Umuyoboro uteganya ibipimo bitandukanye byo kugenzura, hamwe na synthesizer itandukanye itanga amajwi muri bo - ntabwo isohora ingero muburyo butaziguye.

Nibihe bintu bibiri byibanze byerekana amajwi DDSP ikomatanya?

Oscillator yongerera imbaraga ibyara igice, gihuza mugihe urusaku rwungurujwe rwongera umwuka hamwe nuburyo budahuje.

Kuki DDSP ishobora kugera kurwego rwo hejuru hamwe na moderi ntoya ugereranije namakuru make?

Kuberako ibimenyetso bizwi-gutunganya imiterere yubatswe aho kwigishwa kuva kera, umuyoboro ufite bike cyane byo kwiga, kunoza amakuru no gukora neza.

Ni ubuhe buryo bwo gutakaza DDSP ikoresha kugirango igereranye ibyakozwe kandi bigamije amajwi neza?

Kugereranya ubunini bwa spekrogramu kumyanzuro myinshi irakomeye kugirango itandukane ryicyiciro, icyitegererezo-urwego rwigihombo kirwana nacyo.