Mel Spectrograms
Amel spectrogram hoto ne na sauti a kan lokaci, tare da mitar tazara kamar yadda kunnuwan ɗan adam ke fahimtar sauti.
Dubawa
Yana da mahimmanci saboda yana juya ɗanyen sautin sauti zuwa ƙarami, hoto mai ma'ana mai ma'ana wanda ke ba da ikon mafi yawan magana da kiɗan AI.
Zurfafa nutsewa
A mel spectrogram yana jujjuya siginar sauti mai girma ɗaya zuwa taswira mai girma biyu: lokaci yana tafiya tare da axis ɗaya, mita tare da ɗayan, kuma launi ko haske yana nuna kuzari. Maɓallin maɓalli shine ma'aunin mel - ana haɗa mitoci zuwa makada waɗanda ke kunkuntar a ƙananan filaye kuma mafi faɗi a manyan filaye, daidai da yadda jin ɗan adam ke bambanta sautuna mafi kyau a ƙasan kewayon. Wannan yana sa wakilcin ya zama ƙarami kuma ya fi amfani fiye da maƙasudin mitar danye. Saboda yana kama da hoto, hanyoyin sadarwa na juyin juya hali da na'urorin lantarki na iya sarrafa shi kai tsaye, wanda shine dalilin da ya sa mel spectrograms ke ƙarfafa fahimtar magana, gano kalmar farkawa, alamar waƙa, da tsarin rubutu-zuwa-magana na zamani waɗanda ke haifar da spectrogram mel kafin mayar da shi cikin sauti.
Fahimtar Fasaha
Bututun yana farawa da Canjin Saurin Lokaci na ɗan gajeren lokaci: Ana yanke siginar zuwa firam ɗin da suka mamaye juna, kowane taga yana canzawa don bayyana abubuwan mitar sa. Sakamakon bakan wutar lantarki ana wucewa ta hanyar banki na tacewa mai ruɓi mai ruɗi wanda ke tara makamashi zuwa maɗauran sararin samaniya. Ɗaukar logarithm na waɗancan kuzarin bandeji yana matsar da babban ƙarfin ƙarar ƙarar a cikin wani abu da cibiyoyin sadarwa ke ɗauka da kyau, yana ba da sabani na log-mel spectrogram da aka yi amfani da shi azaman shigarwar ƙira.
Dabarun Tasiri
Shiga ku isa
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.
Kudin da kasafin kuɗi
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.
Gudu da sikelin
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.
Makomar Mel Spectrograms
Ko da wasu bincike suna bincika fasalulluka na koyo kai tsaye daga raƙuman raƙuman ruwa, mel spectrograms sun kasance masu rinjaye, ingantaccen shigarwa a cikin AI mai jiwuwa. Ƙwayoyin murya na jijiyoyi waɗanda ke juyar da tsinkayar mel spectrograms komawa cikin magana mai sauti na dabi'a suna ci gaba da ingantawa, haɓaka mafi kyawun rubutu-zuwa-magana da ƙarar murya. Yi tsammanin wakilci na tushen mel zai kasance a tsakiya a cikin ƙirar tushe mai jiwuwa da horarwa na kulawa da kai, tare da gyare-gyare a cikin ƙuduri, koyan filterbanks, da matsananciyar haɗewa tare da yaduwa da samfuran canji na tsarawa.
Aiwatar da Gaskiyar Duniya
Ciyar da spectrograms na log-mel cikin samfuran gane magana kamar ƙarshen tsarin ASR da yawa
Tsarukan rubutu-zuwa-magana kamar Tacotron yana tsinkayar spectrogram mel wanda mai vocoder ya canza zuwa sauti.
Ka'idodin kiɗa suna rarraba nau'in, yanayi, ko kayan kida ta hanyar ɗaukar sikirin azaman hoto
Gano kurakuran na'ura ko sautunan muhalli ta hanyar tsinkayar ƙira a cikin spectrogram
Hatsari & Tsare-tsare
Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.
Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.
Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.
Taswirar Hanya
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.
Gwajin ingantattun masu magana daban-daban da yanayin baya.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Mel Spectrograms quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Riffusion Spectrogram Diffusion
Tambayoyin da ake yawan yi
Menene Mel Spectrograms?
Amel spectrogram hoto ne na sauti a kan lokaci, tare da mitar tazara kamar yadda kunnuwan ɗan adam ke fahimtar sauti. Yana da mahimmanci saboda yana juya ɗanyen sautin sauti zuwa ƙarami, hoto mai ma'ana mai ma'ana wanda ke ba da ikon mafi yawan magana da kiɗan AI.
Menene spectrogram na mel yake wakilta?
Taswirar 2D ce na yawan kuzarin da ke kasancewa a kowane rukunin mitar kan lokaci, tare da mitar akan sikelin fahimta.
Menene na musamman game da ma'aunin mel?
Ma'auni na mel yana amfani da kunkuntar makada a ƙananan filaye da kuma fadi a manyan filaye, yana kwatanta fahimtar farar ɗan adam.
Wanne canji shine mataki na farko na gina spectrogram mel?
STFT yana yanke sautin zuwa cikin firam ɗin taga kuma yana bayyana mitar abun ciki na kowanne, wanda sannan aka tsara shi zuwa mel bands.
Me yasa ake yawan amfani da logarithm akan kuzarin mel band?
Ƙaƙƙarfan ƙararrawa ta zarce babban kewayon; Ɗaukar log ɗin yana matse shi don haka hanyoyin sadarwa na jijiyoyi za su iya koya daga gare ta cikin sauƙi, suna ba da spectrogram na log-mel.
Me yasa mel spectrograms suka dace da abubuwan shiga don cibiyoyin sadarwa na jijiyoyi?
Tsarin su na 2D mai kama da hoto yana ba da damar yin amfani da tsarin gine-ginen hangen nesa kai tsaye zuwa sauti.