DDSP Bambancin Audio Synthesis
DDSP (Bambancin Tsarin Siginar Dijital) yana haɗa tubalan gine-gine na yau da kullun tare da cibiyoyin sadarwa na jijiyoyi, don haka zurfin koyo na iya sarrafa oscillators da tacewa kai tsaye.
Dubawa
It produces strikingly natural, controllable instrument sounds with tiny models and little data.
Zurfafa nutsewa
DDSP, wanda ƙungiyar Magenta ta Google ta gabatar a cikin 2020, tana sake tunanin tsara sautin jijiya. Madadin hanyar sadarwa tana tsinkayar samfuran sautin sauti ɗaya bayan ɗaya (kamar WaveNet) ko pixels na spectrogram, DDSP yana yin abubuwan DSP na al'ada - ƙari oscillator mai jituwa, mai tace amo janareta, da reverb - bambanta. Wannan yana nufin gradients na iya gudana ta cikin su yayin horo, don haka ƙaramar hanyar sadarwa ta jijiyoyi ta koyi fitar da siginar sarrafawa masu fassara: ainihin farar sauti, ƙarar gabaɗaya, da yawan adadin jituwa a kan lokaci. Mai haɗawa sannan yana samar da ainihin sautin daga waɗannan abubuwan sarrafawa. Saboda ilimin kimiyyar lissafi na sauti ana gasa a cikin gine-gine maimakon koya daga karce, DDSP yana samun babban inganci tare da ƙarancin sigogi da misalai na horarwa, kuma yana barin masu amfani da kansu su sarrafa farar sauti, ƙara, da katako - har ma da canja wurin timbre, kamar yin kiɗan murya azaman violin.
Fahimtar Fasaha
Jigon sigar ƙirar ƙirar ƙirar ƙira ce: bankin oscillator mai jituwa yana haifar da jimillar raƙuman raƙuman raƙuman ruwa a yawan adadin madaidaicin mitar, yayin da wata hanya ta daban ke tace farin amo don numfashi da laushi mai laushi. Cibiyar sadarwa ta jijiyoyi ba ta taba fitar da sauti kai tsaye ba - tana fitar da sigogin sarrafawa masu bambanta lokaci (f0, ƙara, rarraba jituwa, masu tacewa). Horowa yana amfani da asarar sikelin sikeli da yawa kwatankwacin ƙirƙira da sauti mai niyya a cikin girman taga FFT da yawa, wanda ke da ƙarfi ga bambance-bambancen lokaci.
Dabarun Tasiri
Shiga ku isa
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.
Kudin da kasafin kuɗi
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.
Gudu da sikelin
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.
Makomar DDSP Mai Rarraba Audio Synthesis
DDSP yana turawa na ainihin-lokaci, ƙananan kayan aikin jijiya da tasirin sauti waɗanda ke gudana akan ƙananan kayan aiki, gami da mai lilo da kan na'urorin da aka haɗa. Ikon sarrafa shi da ake iya fassara shi ya sa ya dace don bayyana kayan aikin aiki da na'urori masu haɗawa inda mawaƙa ke buga timbre kai tsaye. Masu bincike suna faɗaɗa ra'ayin-DSP mai bambance-bambancen zuwa ƙirar jiki, acoustics na ɗaki, da cikakkun sassan samar da sauti, suna haɗawa da sarrafa sarrafa siginar gargajiya tare da gaskiyar zurfin koyo a cikin ƙirƙirar kiɗa da ƙirar sauti.
Aiwatar da Gaskiyar Duniya
Kayan aikin canja wurin timbre waɗanda ke ɗaukar waƙar waƙa ko rera da sake mayar da ita azaman violin, sarewa, ko ƙaho a ainihin lokacin.
Fasinjojin jijiyoyi masu nauyi masu nauyi waɗanda mawaƙa ke sarrafawa tare da fa'ida, ƙara, da kulli mai haske.
Gyara-gyara da bayyana sake haɗawa da kayan aikin da aka yi rikodin yayin adana dalla-dalla na jituwa na yanayi.
Mujallar kide-kide na mu'amala ta tushen burauza wacce ke haifar da sautin kayan aiki na gaske ba tare da samfuran GPU masu nauyi ba.
Hatsari & Tsare-tsare
Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.
Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.
Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.
Taswirar Hanya
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.
Gwajin ingantattun masu magana daban-daban da yanayin baya.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DDSP Differentiable Audio Synthesis quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
AudioGen Rubutu-zuwa-Audio Synthesis
Tambayoyin da ake yawan yi
What is DDSP Differentiable Audio Synthesis?
DDSP (Bambancin Tsarin Siginar Dijital) yana haɗa tubalan gine-gine na yau da kullun tare da cibiyoyin sadarwa na jijiyoyi, don haka zurfin koyo na iya sarrafa oscillators da tacewa kai tsaye. Yana samar da sauti na kayan aiki mai ban mamaki, mai iya sarrafawa tare da ƙananan ƙira da ƙananan bayanai.
Menene mabuɗin ƙirƙira a bayan DDSP?
DDSP tana juya tubalan gine-ginen na'ura na al'ada zuwa nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan DDSP suna barin hanyar sadarwa ta jijiyoyi ta koyi sarrafa su ta hanyar watsawa.
A cikin DDSP, menene ainihin hanyar sadarwar jijiyoyi ke fitarwa?
Cibiyar sadarwa tana annabta sigogin sarrafawa masu bambance-bambancen lokaci, kuma keɓantaccen mai haɗawa yana ba da sautin daga gare su - ba ta taɓa fitar da samfuran kai tsaye ba.
Wadanne manyan abubuwan samar da sauti guda biyu ne na'urar hada sauti ta DDSP ta hada?
Ƙarar oscillator mai jituwa yana haifar da kafaffen, ɓangaren jituwa yayin da tace amo yana ƙara numfashi da rubutu mara kyau.
Me yasa DDSP zai iya cimma babban inganci tare da ƙananan ƙira da ƙananan bayanai?
Saboda sanannen tsarin sarrafa sigina an gina shi a ciki maimakon koya daga karce, hanyar sadarwar ba ta da nisa don koyo, inganta bayanai da ingancin siga.
Wane aiki asara DDSP ke amfani da shi don kwatanta sauti da aka ƙirƙira da niyya da ƙarfi?
Kwatanta girman spectrograms a ƙuduri da yawa yana da ƙarfi ga bambance-bambancen lokaci, wanda asarar matakin samfurin ke kokawa da shi.