HuBERT Ijambo Ryigenga
HuBERT (Byihishe-Igice BERT) ni Meta AI yerekana imvugo yigenga yigenga yiga mu guhanura ibice byamajwi bikusanyirijwe mubice byapimwe, uburyo bwa BERT.
Incamake
It matters because its clustering-based targets often outperform earlier contrastive methods on recognition and downstream speech tasks.
Kwibira cyane
Yarekuwe na Meta AI mu 2021, HuBERT ihuza igitekerezo cyo guhisha-guhanura inyuma ya BERT nijambo rito. Guhanga udushya nuburyo butangiza intego zamahugurwa: aho gutandukanya ibiturangaza nka Wav2Vec 2.0, HuBERT ikoresha intambwe yo guhuza interineti (k-bisobanura) hejuru y amajwi kugirango igabanye buri kintu kigufi ikirango cyihariye. Moderi noneho ihisha ibice byamajwi ikamenya guhanura ibirango bya cluster kumurongo wihishe, ifata imvugo nkurukurikirane rwa pseudo-fonema. By'umwihariko, HuBERT isubiramo: irongera ikusanya ikoresheje icyitegererezo cyayo cyanonosowe kandi ikongera ikongera, ikarushaho gukarishya ibice bigenewe. Uku kunonosora ibintu bitanga ibintu bikomeye birenze ASR, umuvugizi, nibipimo byamarangamutima nka SUPERB.
Ubushishozi
Ubwiza bwa HuBERT buri mu gukuramo ibisekuruza biva mu guhanura. Kwisubiramo hakiri kare ibintu byoroshye MFCC biranga k-bisobanura amasomo; nyuma yo gusubiramo ihuriro ryihishwa kuva murwego rwo hagati rwa Transformer layer, ikubiyemo amakuru akungahaye kuri fonetike. Kuberako icyitegererezo gikeneye gusa guhanura indangamuntu kumwanya wihishe, intego ziguma zihamye nubwo ihuriro ridatunganye, kureka urusobe rukiga imiterere ya acoustic nindimi zidafite inyandiko-mvugo.
Ingaruka z'Ingamba
Kugera no kugera
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Igiciro na bije
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Umuvuduko n'igipimo
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Kazoza ka HuBERT Kwiyobora Ijambo
HuBERT yabaye umusingi wa NLP idafite inyandiko, harimo nururimi ruvugwa rutanga imvugo iturutse mubice byizewe bidafite umwandiko wo hagati. Ibice byihishe bigaburira imvugo, guhinduranya amajwi, hamwe no guhinduranya imvugo. Tegereza uburyo bwa HuBERT bwerekana ibimenyetso kugirango ushigikire icyiciro cyikigereranyo cyururimi rwamajwi rufata imvugo nkuko LLMs ifata inyandiko, wongeyeho gukomeza kwanduzanya hamwe nururimi rwindimi nyinshi kandi rwinshi.
Gushyira mu bikorwa Isi
Gukora imvugo yihariye yerekana imvugo idafite imvugo-yerekana imvugo
Gutegura ibintu bikomeye bikuramo ibintu neza neza neza kubutunzi buke ASR
Gutwara amajwi guhindura no guhindura imvugo-ijambo ukoresheje ibice byize
Gukora nkumugongo wapimwe murwego rwa SUPERB rwimirimo yo kuvuga
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the HuBERT Self-Supervised Speech quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwigenzura wenyine
Ibibazo bikunze kubazwa
What is HuBERT Self-Supervised Speech?
HuBERT (Byihishe-Igice BERT) ni Meta AI yerekana imvugo yigenga yigenga yiga mu guhanura ibice byamajwi bikusanyirijwe mubice byapimwe, uburyo bwa BERT. Nibyingenzi kuberako intego zayo zishingiye kumurongo akenshi zirusha uburyo butandukanye bwo kumenyekanisha no kumenyekanisha imirimo yo hasi.
Nigute HuBERT itanga intego igerageza guhanura mugihe cy'amahugurwa?
HuBERT ihuriro ryamajwi yerekana amajwi (ikoresheje k-uburyo) mubice byihariye byihishe kandi irahanura ibyo birango bya cluster kubipfundikizo.
Ni ubuhe bwoko bw'inyandiko buzwi bwahumekeye HuBERT gahunda yo guhugura-guhanura?
HuBERT (Hidden-Unit BERT) itira BERT intego yo guhanura-guhanura, kuyikoresha mubice bitandukanya imvugo aho kwerekana ibimenyetso.
Nigute HuBERT itezimbere ibirango byayo hejuru yimyitozo ikurikirana?
HuBERT isubiramo: nyuma izenguruka cluster ikize cyane ibintu byihishe uhereye kumurongo wikitegererezo, bikarishye intego za pseudo-phoneme.
Ni ibihe bintu bikunze guhurizwa hamwe muri HuBERT ya mbere cyane?
Itangiriro rya iterateri yibanze yibanze ya MFCC; nyuma yo gusubiramo ukoreshe Transformer-layer igaragara.
Kuki HuBERT ishobora kwiga imiterere yingirakamaro nubwo ihuriro ryayo ridatunganye?
Kuberako intego ari uguhitamo gusa indangamuntu zahawe indangamuntu zipfundikijwe, umurimo ukomeza kwigishwa kandi uhoraho nubwo urusaku rwuzuye urusaku.