HuBERT Kaddu buñuy saytu boppam
HuBERT (BERT bu nëbbu) mooy Meta modelu wax bu IA di saytu boppam, di jàng ci xam luy waaja am ci wàllu audio yuñ boole ngir wàll yuñ maske, nuru BERT.
Résumé
It matters because its clustering-based targets often outperform earlier contrastive methods on recognition and downstream speech tasks.
Plongeur bu xóot
_AIU_PROTECTED_13__ AI moo ko genne ci 2021, HuBERT dafay méngale xalaatu wax luy am ci ginaaw BERT ak wax ju ñor. Li gëna am solo mooy ni ñuy defaree ay mbir ngir tàggat: ludul wuute ak ay distractor yu melni Wav2Vec 2.0, HuBERT dafay doxal jéego bu amul lëkkaloo (k-means) ci kaw man-mani audio ngir jox kadre bu gàtt bu nekk etiketu 'unité bu nëbbu'. Ginaaw loolu model bi dafay maske pàcci audio bi ba noppi jàng xam luy waaja am ci etiketu cluster yi ngir kadre yu nëbbu yi, di jàppee wax ji ni ay pseudo-phoneme yu toppalante. Lu gëna am solo, HuBERT dafay baamtu: dafay boolewaat ay cluster yu jëfandikoo model bi boppam, ba noppi di tàggataat, di gëna ñawloo yunit yiñ bëgga jëfandikoo. Bii bouclage de raffinement dafay defar ay man-mani yu am doole yu gëna mag ci ASR, waxkat, ak benchmark yu melni SUPERB.
Gis-gis xarala
Taaru HuBERT mingi ci tàqale li ñuy wut ak li ñuy wax luy waaja am. Iterasioŋ yu njëkk ya dañu boole màndarga MFCC yu yomb yi ci klaas k-means; iterasioŋ yu ci topp dañuy boole vecteur yu nëbbu yi ci diggu Transformer yi, ñuy kode xibaar fonetik bu gëna riis. Ndax model bi soxlawul ludul seetlu ID cluster yi ci barab yuñ maske, mébet yi dañuy wéy di nekk doonte clustering bi jaarul yoon, loolu mooy tax reso bi jàng structure akustik ak linguistic bu am solo te amul benn transcription.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu kàddu yu HuBERT di saytu boppam
HuBERT moo nekkoon fondaasioŋ ngir PNL bu amul mbind, boole ci xeeti làkk yuñ wax yuy defar kàddu ci unité yu wuute yuñ jàng te amul mbind ci digg bi. Unité yu nëbbu yi dañuy dundal synthese kàddu, soppi baat, ak pipeline tekki kàddu ci kàddu. Xaarandi jeton yu diskret yu nuroo ak HuBERT ngir jàppale xeetu làkk audio yuy màgg yuy jëfandikoo kàddu yi ci anam wi LLM yi di jëfandikoo mbind, boole ci wéyal cross-pollination ak xeetu fondasioŋ yu bari ak yu bari.
Doxal ci àdduna dëgg
Defar ay jeton wax yu wuute ngir modeli defar làkk wiñ wax te amul mbind
Taggat ay extracteur yu am doole yuñ defar ngir ASR yu néew doole
Dawal soppi baat ak tekki kàddu ci kàddu jaaraleko ci unité yuñ jàng
Liggéey ni yaxu ndigg buñ méngale ci liggéeyi wax yu SUPERB
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the HuBERT Self-Supervised Speech quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Jàng bu ñuy saytu sa bopp
Laaj yi ñuy faral di laaj
What is HuBERT Self-Supervised Speech?
HuBERT (BERT bu nëbbu) mooy Meta modelu wax bu IA di saytu boppam, di jàng ci xam luy waaja am ci wàllu audio yuñ boole ngir wàll yuñ maske, nuru BERT. Dafa am solo ndax ay mébetam yu lalu ci clustering dañuy faral di gëna mëna jëfandikoo pexe yu njëkk ya ci wàllu xàmmee ak liggéey yi ci wàllu wax.
naka la HuBERT di defaree ay mébet yu mu jéema seetlu ci diiru tàggat yaram?
HuBERT dafay boole man-mani kadre audio yi (jaaraleko ci k-means) ci ay yunit yu nëbbu yu wuute ba noppi di wax luy waaja am ci etiketu kadre yiñ maske.
Ban xeetu bind bu siiw moo inspiré HuBERT ci tàggat yaram bu maskewu?
HuBERT (Hidden-Unit BERT) dafay leble mébetu wax luy waaja am ci BERT, jëfandikoo ko ci pàccu kàddu yu wuute ci barabu token bind.
naka lay def ba HuBERT gëna suqali ay etiketam ci wàllu tàggat yaram yu toppalante?
HuBERT dafay baamtu: rond yu ci topp dañuy boole màndarga yu nëbbu yi gëna riis ci diisaayi model bi boppam, di ñaw pseudo-phoneme yiñ bëgga jëfandikoo.
Lan mooy màndarga yiñ gëna boole ci iteration bu njëkk bi ci HuBERT?
Iteraasioŋ bu njëkk bi dafay boole màndarga MFCC yu njëkk yi; iterasioŋ yi ci topp dañuy jëfandikoo misaali couche Transformer yu gëna riis.
Lan moo waral HuBERT mëna jàng structure bu am njariñ doonte clustering bi jaarul yoon?
Ndax liñu bëgga mooy seetlu ID cluster yiñ jox kadre yuñ maske, liggéey bi dafay wéy di jàng te dina wéy doonte cluster yu bari xumbaay la.