Ubuyobozi bwa Audio AI

Mel-Frequency Cepstral Coefficients

Coefficients ya Mel-Frequency Cepstral (MFCCs) ni igiteranyo cyimibare igereranya incamake yimiterere yumurongo wijwi nkuko amatwi yabantu abibona.

Incamake

Coefficients ya Mel-Frequency Cepstral (MFCCs) ni igiteranyo cyimibare igereranya incamake yimiterere yumurongo wijwi nkuko amatwi yabantu abibona. Mu myaka ibarirwa muri za mirongo bari ibikoresho byakazi byo kumenyekanisha imvugo, kumenyekanisha abavuga, no gusesengura umuziki.

Coefficients ya Mel-Frequency Cepstral yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

MFCCs ihindura igice kigufi cyamajwi mumibare igera kuri 13 ifata timbre yayo. Umuyoboro ufata imiraba, ukayicamo ibice ~ 25ms, ikabara amashanyarazi binyuze muri transformateur ya Fourier, hanyuma ikarwanya umurongo wikurikiranya kugeza ku gipimo cya mel, ikaba ihuza imirongo nkuko cochlea ikora: neza munsi ya 1kHz kandi hejuru cyane. Ingufu za mel zirahuzagurika (kwigana amajwi aranguruye) hanyuma amaherezo ikanyuzwa muri cosine yihariye, ikayitandukanya kandi igahuza amakuru muri coefficient ya mbere. Igisubizo kirakomeye cyane ku rusaku no kuvuga, niyo mpamvu uburyo bwa kera bwa Hidden Markov Model hamwe na Gaussian Mixture Model imvugo yo gushingira kuri MFCC hafi ya hose mbere yo kwiga byimbitse.

Ubushishozi

Igipimo cya mel kigereranya imyumvire hamwe na mel = 2595 log10 (1 + f / 700), bityo intambwe zingana zingana zumvikana neza. Impinduka ya nyuma ya cosine ihinduka (DCT) nintambwe ya 'cepstral': ifata log-mel spektrike nkikimenyetso kandi igatandukanya buhoro buhoro imiterere-yijwi ryinzira (coefficient nkeya ya cepstral, igice dukomeza) hamwe nihuta ryihuta ryihuta (coefficient nyinshi, ubusanzwe zajugunywe), zitandukanya neza indangamuntu ya fonetike mukuvuga.

Kumenya Mel-Frequency Cepstral Coefficients

Coefficients ya Mel-Frequency Cepstral (MFCCs) ni igiteranyo cyimibare igereranya incamake yimiterere yumurongo wijwi nkuko amatwi yabantu abibona. Mu myaka ibarirwa muri za mirongo bari ibikoresho byakazi byo kumenyekanisha imvugo, kumenyekanisha abavuga, no gusesengura umuziki. Coefficients ya Mel-Frequency Cepstral yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata Mel-Frequency Cepstral Coefficients nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha Mel-Frequency Cepstral Coefficients ifata ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza ka Mel-Frequency Cepstral Coefficients

Imiyoboro yimbitse-iherezo iragenda yiga ibintu biturutse kumurongo wibanze cyangwa log-mel spectrograms, gusimbuka DCT, bityo MFCCs nziza ziragenda zishira muburyo bugezweho bwa ASR. Nyamara baracyakunzwe cyane kuburemere bworoshye, kubikoresho, hamwe namakuru make-yamakuru: ijambo ryibanze ryerekana, ibikorwa byerekana amajwi, gutunga amajwi, hamwe na bioacoustics. Tegereza MFCCs ikomeze nkibikorwa byiza, bisobanurwa nubwo byize imbere-impera yiganje kuri moderi nini.

Gushyira mu bikorwa Isi

Ibiranga Acoustic kubisanzwe HMM-GMM imenyekanisha imvugo nka sisitemu ya mbere ya Sphinx na HTK

Kugenzura abavuga no gutandukana, gutandukanya abavuga kumuhamagaro

Ibyiciro byumuziki gutondeka no gutunga urutoki (Shazam-style ya timbre ihuza)

Kumenya amakosa yimashini cyangwa guhamagarira inyamanswa kumajwi mugukurikirana inganda na bioacoustic

Uburyo bwo Gushyira mu bikorwa

Mel-Frequency Cepstral Coefficients mubikorwa

Ibiranga Acoustic kubisanzwe HMM-GMM imenyekanisha imvugo nka sisitemu ya mbere ya Sphinx na HTK.

Ibiranga Acoustic kubintu bisanzwe bya HMM-GMM bamenyekanisha imvugo nka sisitemu ya mbere ya Sphinx na HTK Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo bikurikirana, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.

Mel-Frequency Cepstral Coefficients mubikorwa

Kugenzura abavuga no gutandukana, gutandukanya abavuga kumuhamagaro.

Kugenzura abavuga no gutandukanya, gutandukanya abavuga kumuhamagaro Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Mel-Frequency Cepstral Coefficients mubikorwa

Ubwoko bwumuziki gutondekanya no gutunga urutoki (Shazam-style ya timbre ihuza).

Gutondekanya injyana yumuziki no gutunga urutoki (Shazam-style ya timbre ihuza) Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Mel-Frequency Cepstral Coefficients mubikorwa

Kumenya amakosa yimashini cyangwa guhamagarira inyamanswa kumajwi mugukurikirana inganda na bioacoustic.

Kumenya amakosa yimashini cyangwa guhamagarwa kwinyamanswa bivuye mumajwi mugukurikirana inganda na bioacoustic Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi