Mel Spectrograms
Mel spekrogramu ni ishusho yijwi mugihe, hamwe ninshuro zingana uko amatwi yabantu abona ikibanza.
Incamake
It matters because it turns raw audio into a compact, perceptually meaningful image that powers most speech and music AI.
Kwibira cyane
Mel spekrogramu ihindura icyerekezo kimwe cyamajwi yerekana ikarita muburyo bubiri: igihe kigenda gikurikira umurongo umwe, umurongo ukurikira urundi, kandi ibara cyangwa umucyo byerekana imbaraga. Urufunguzo rwo kugoreka ni igipimo cya mel - imirongo ihuriweho mumatsinda ifunganye mu bibanza bito kandi yagutse ku bibuga birebire, bihuye nuburyo kumva kwabantu gutandukanya amajwi neza hepfo yurwego. Ibi bituma guhagararirwa byombi bito kandi bifite akamaro kuruta ibibanza byinshyi. Kuberako isa nishusho, imiyoboro ihamye hamwe na transformateur irashobora kuyitunganya muburyo butaziguye, niyo mpamvu mel spekrogramu ishimangira kumenyekanisha imvugo, gukanguka-gutahura ijambo, gutondekanya imiziki, hamwe na sisitemu igezweho-y-imvugo itanga mel spekrogramu mbere yo kuyisubiza mu majwi.
Ubushishozi
Umuyoboro utangirana no Guhindura-Igihe gito Fourier Guhindura: ibimenyetso byaciwemo ibice byuzuzanya, buri idirishya kandi rihinduka kugirango ryerekane ibiyikubiyemo. Imbaraga zavuyemo noneho zinyuzwa muri banki yuzuye hejuru ya mpandeshatu zungurura zungurura imbaraga mumirongo igaragara neza. Gufata logarithm yizo mbaraga za bande bigabanya imbaraga nini zingufu zijwi mubintu runaka bikora neza, bigatanga log-mel yamenyerewe ikoreshwa nkicyitegererezo.
Ingaruka z'Ingamba
Kugera no kugera
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Igiciro na bije
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Umuvuduko n'igipimo
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Kazoza ka Mel Spectrograms
Nubwo ubushakashatsi bumwe na bumwe bugaragaza uburyo bwo kwiga buturutse kumiterere mbisi, mel spekrogramu ikomeza kwiganza, kwinjiza neza mumajwi ya AI. Indangururamajwi zihindura mel spekrogramu zahanuwe zisubira mu mvugo yumvikana-komeza ukomeze gutera imbere, utere umwandiko mwiza-ku-jambo no gutondeka amajwi. Tegereza mel-shusho yerekana kuguma hagati muburyo bwamajwi yerekana amajwi no kwiyobora wenyine, hamwe no kunonosorwa mubyemezo, wize filterbanks, hamwe no guhuza cyane hamwe no gukwirakwiza no guhindura moderi kubisekuruza.
Gushyira mu bikorwa Isi
Kugaburira log-mel spectrogrammes muburyo bwo kumenyekanisha imvugo nkimpera yimbere ya sisitemu nyinshi ASR
Sisitemu yo kuvuga-imvugo nka Tacotron guhanura mel spekrogramu ya majwi noneho ijwi rikayihindura amajwi
Porogaramu zumuziki zerekana ubwoko, imiterere, cyangwa ibikoresho bifata spekrogramu nkishusho
Kumenya amakosa yimashini cyangwa amajwi yibidukikije mugushakisha uburyo bwo kuvuga muri ecran
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Mel Spectrograms quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Riffusion Spectrogram Diffusion
Ibibazo bikunze kubazwa
What is Mel Spectrograms?
Mel spekrogramu ni ishusho yijwi mugihe, hamwe ninshuro zingana uko amatwi yabantu abona ikibanza. Nibyingenzi kuko bihindura amajwi mbisi muburyo bworoshye, bwumvikana busobanutse butanga imvugo numuziki AI.
Mel spekrogramu igereranya iki?
Ni ikarita ya 2D yingufu zingana kuri buri tsinda ryumwanya mugihe, hamwe ninshuro kurwego rwo kwiyumvisha.
Niki kidasanzwe mubipimo bya mel?
Igipimo cya mel gikoresha imirongo migari mu bibuga bito kandi binini ku bibuga birebire, bikerekana imyumvire yabantu.
Ni izihe mpinduka nintambwe yambere yo kubaka mel spekrogramu?
STFT ikata amajwi mumadirishya akadirishya kandi ikagaragaza inshuro zinshyi za buri, hanyuma igashushanywa na mel band.
Ni ukubera iki logarithm ikoreshwa muburyo bwa mel band?
Ijwi rirenga rinini cyane; gufata logi irabihagarika kugirango imiyoboro yimitsi ishobora kubyigiraho byoroshye, itanga log-mel spectrogram.
Ni ukubera iki mel spectrograms yorohereza inyongeramusaruro?
Imiterere ya 2D ishusho imeze ireka iyerekwa-yuburyo bwububiko bukoreshwa muburyo butaziguye kumajwi.