Spektrogram Mel
Spectrogram mel mooy nataalu son bi ci diir bu gàtt, ak frequency yu wuute ci anam wi noppi nit ñi di gisee ton bi.
Résumé
It matters because it turns raw audio into a compact, perceptually meaningful image that powers most speech and music AI.
Plongeur bu xóot
Spectrogram mel dafay soppi forme onde audio bu am benn dimension ci kàrt bu am ñaari dimension: waxtu wi dafay jaar ci benn axe bi, fréquence bi dafay jaar ci beneen axe bi, melo bi wala leeraay bi dafay wane energie. Twist bi gëna am solo mooy mel scale - frequency yi dañu leen boole ci bande yu sew ci ton yu woyof yi ak yu gëna yaatu ci ton yu kawe yi, mu méngoo ak ni déglu nit di gëna xàmmee ton yi ci suufu rang bi. Loolu mooy tax représentation bi gëna ndaw ba noppi gëna am njariñ ci tracé fréquence bu ñor. Ndax dafa niru ak nataal, reso convolutionnel yi ak transformateur yi mën nañu ko jëfandikoo ci saasi, moo tax spectrogram mel yi dañuy jàppale xàmmee kàddu yi, gis baat yiy yeewu, etiketu music, ak sistem yu bees yu bind-ci-kaddu yiy defar spectrogram mel balaa ñu koy delloo ci audio.
Gis-gis xarala
Tuyo bi dafay tàmbali ci coppite Fourier bu gàtt: dañuy dagg siñaal bi ci kaadar yuy jaxasoo, bu nekk ci ñoom am palanteer ba noppi soppi ko ngir wane ëmbiitu fréquence bi. Spectre doole biy génne dañu koy jaar ci bànku filtre mel yu am ñatti kaar yuy jaxasoo, ñuy boole energie bi ci ay bande yu wuute. Jël logarithm bu energie bande yooyu dafay tënk rang dynamique bu rëy bi ci lu reso yi mëna jëfandikoo bu baax, loolu mooy joxe spectrogram log-mel biñ miin bi ñuy jëfandikoo ci model input.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu Spektrogram Mel
Doonte yenn gëstu yi dañuy saytu man-mani jàng yi jubal ci forme vague yu ñor, spectrogram mel yi ñu ngi wéy di nekk dugal bu am solo, am njariñ ci IA audio bi. Vocoder neuronal yiy soppi spectrogram mel yiñ séentu ci kàddu yuy sonn ñu ngi wéy di gëna dëgaral, di dawal cloning text-ci-speech ak baat bu gëna baax. Xaarandi mel-based représentation ngir des ci digg bi ci modelu fondation audio ak pre-training buñuy saytu boppam, ak ay coppite ci dayo, jàng filtrebanks, ak boole bu dëgër ak modelu diffusion ak transformateur ngir generation.
Doxal ci àdduna dëgg
Dugalal spectrogram log-mel ci xeetu xàmmee kàddu yu melni front end ci sistem ASR yu bari
Sistem yiy soppi bind ci kàddu yu melni Tacotron di wax luy waaja am ci spectrogram mel bi vocoder bi di soppi def ko audio
Aplikaasioŋu musical yiy xaaj genre, humeur wala jumtukaay ci jëfandikoo spectrogram bi ni nataal
Gis ay njuumte ci masin bi wala son environmaa bi ci gis motif yiy wane ci spectrogram bi
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Mel Spectrograms quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Spektrogram diffusion
Laaj yi ñuy faral di laaj
What is Mel Spectrograms?
Spectrogram mel mooy nataalu son bi ci diir bu gàtt, ak frequency yu wuute ci anam wi noppi nit ñi di gisee ton bi. Dafa am solo ndax dafay soppi audio bu ñor ci nataal bu dëgër, bu am solo buy dundal wax ak music IA.
Luy spectrogram mel?
Dafay wane kàrt 2D buy wane bariwaayu energie bi am ci bande fréquence bu nekk ci diir bu gàtt, ak fréquence ci echelu perceptuel.
Lan moo gëna neex ci balansu mel bi?
Balaas mel dafay jëfandikoo bande yu gëna sew ci ton yu woyof yi ak yu gëna yaatu ci ton yu kawe yi, di wane ni nit ñi di gisee ton yi.
Ban coppite mooy jéego bu njëkk bi ñuy jël ngir defar spectrogram mel?
STFT dafay dagg audio bi ci ay kadre yu am palanteer ba noppi wane ëmbiitu frequency bu nekk ci ñoom, ñu boole ko ci bande mel yi.
Lan moo waral ñuy jëfandikoo logarithm ci energie band mel yi?
Kàddu gi dafay yaatu ci anam wu yaatu; jël log bi daf koy kompresse suko defee reso neuronal yi mëna jàngee ci lu gëna yomba, loolu mooy joxe spectrogram log-mel.
Lan moo waral spectrogram mel yi nekk ay dugal yu baax ci reso neuronal yi?
Seenug jëmmal bu nuru nataal 2D dafay tax ñu mëna jëfandikoo architecture yu nuru gis-gis ci audio bi ci anam wu yomb.