GUIDE IA Audio

SpecAugment ngir xàmmee kàddu

SpecAugment xeetu yokk done bu yomb la waaye am doole, muy maske ak deforme spectrogramu kàddu ngir gëna dëgëral xeetu xàmmee yi.

2 simili jàngDañu mujjee yeesal

Résumé

It boosted accuracy on benchmarks without any new audio or model changes.

Plongeur bu xóot

SpecAugment, bi Brain (Park ak ñeneen) dugal ci 2019, dafay yokk tàggat xamme kàddu ci soppali spectrogram log-mel bi ci saasi moo gën forme onde bu ñor bi. Dafay jëfandikoo ñatti mbir: time warping, muy tàllal tuuti wala di kompresse audio bi ci axis time bi; maske fréquence, biy dindi bande chaine fréquence yi; ak maskeer waxtu, luy dindi jéego yu yàgg yi. Su SpecAugment forse model bi mu xàmmee wax doonte ay pàcc ci spectrogram bi dañu nëbbu, SpecAugment dafay nekk regularisation ba noppi moytu overfitting. Dafa yomb lool te am njariñ, di jàppale xeetu LAS ñu yegg ci njuumti yi gëna mag ci LibriSpeech ak Switchboard, te mingi wéy di nekk ingredient biñ jagleel pipeline tàggat ASR yu bees yi.

Gis-gis xarala

SpecAugment dafay dox ci spectrogram 2D ​​melni ab nataal. Maskeer fréquence dafay dindi benn bloku chaine de fréquence mel; maskeer waxtu dindi ab bloku kadre yu bari; deformaasioŋ waxtu dafay soppi poñ biñ tànn ci axis waxtu bi ci jëfandikoo interpolaasioŋ. Mën nañu def mask yu bari ci wax ju nekk. Ndax mask yi dañuy soppeeku jamono bu nekk, model bi dafay gis xeetu wuute yu bari ci misaal bu nekk, gëna suqali generalisation te du dajale ay done yu bees.

njeextalu pexe

Dugg ak yegg

Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.

Njëgg ak budget

Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.

Gaawaay ak yaatuwaay

Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.

Ëlëgu SpecAugment ngir xàmmee kàddu

SpecAugment nekk na default bu jege-universel ci xàmmee kàddu yi te mingi tasaaroo ci yeneen liggéey audio yu melni xool kàddukat yi ak xaaj son yi. Liggéey bi ci topp dafay aju ci politiku maskeer ci saasi wala mu méngale leen ci diiru tàggat, ba noppi boole maskeer spectrogram ak mébetu tàggat-yaram bu ñuy saytu seen bopp. Lu model yi di gëna màgg, yokk bu yomb biy yokk doole te du am benn etiketu audio bu gëna am solo, rawatina ci làkk yu néew doole yi nga xamni done yi bariwul.

Doxal ci àdduna dëgg

Yokkatal njuumti ci kàddu ci LibriSpeech ci maskeer bande spectrogram yi ci diiru tàggat yaram

Yamale xeetu ASR yu mujj ba ci njeexte yu melni LAS wala Conformer ngir wàññi jëfandikoo gu ëpp

Yokk ay done yu néew ngir làkk yu néew doole te doo enregistre ay audio yu bees

Defar xalaatu maske ngir saytu kàddukat yi ak xaaj xew-xewu audio

Risk yi ak balustrade yi

Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.

Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.

Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.

Roadmap ngir samp gi

1

Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.

2

Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.

3

Mandargal kañ la nit wara xoolaat wala nangu ay génne.

4

Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.

Weyal di banneexu

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the SpecAugment for Speech Recognition quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tambalil quiz

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Gis bi ci topp

Jumtukaayu xàmmee kàddu Kaldi

Laaj yi ñuy faral di laaj

What is SpecAugment for Speech Recognition?

SpecAugment xeetu yokk done bu yomb la waaye am doole, muy maske ak deforme spectrogramu kàddu ngir gëna dëgëral xeetu xàmmee yi. Dafa yokk njub ci benchmarks te amul benn coppite ci audio wala model bu bees.

Lu SpecAugment di doxalee?

SpecAugment dafay soppali spectrogram bi (waxtu-fréquence bi) ci saasi moo gën forme onde bu ñor bi.

Ci ñatti liggéey yi SpecAugment def, ban ci ñoom mooy?

Ñatti mbir yooyu ñooy: deformasioŋ ci waxtu, maske fréquence, ak maske ci waxtu.

Luy jubluwaay bu njëkk ci SpecAugment?

Su amee wàll ci spectrogram bi, dafay forse model bi mu yamale, wàññi overfitting bi ak wàññi njuumte yi.

Luy 'masking temps'?

Maskeer waxtu dafay nul ab bloku kadre yu toppalante ci axis waxtu spectrogram bi.

Lan moo waral soppi mask yi jamono bu nekk di jàppale?

mask yu bari yu wuute ci jamono bu nekk dafay tekki ni model bi dafay daje ak coppite yu bari, gëna suqali generalisation te amul done yu bees.