Ubuyobozi bwa Audio AI

HuBERT Ijambo Ryigenga

HuBERT (Byihishe-Igice BERT) ni Meta AI yerekana imvugo yigenga yigenga yiga mu guhanura ibice byamajwi bikusanyirijwe mubice byapimwe, uburyo bwa BERT.

2 min somaIbiherutse kuvugururwa

Incamake

It matters because its clustering-based targets often outperform earlier contrastive methods on recognition and downstream speech tasks.

Kwibira cyane

Yarekuwe na Meta AI mu 2021, HuBERT ihuza igitekerezo cyo guhisha-guhanura inyuma ya BERT nijambo rito. Guhanga udushya nuburyo butangiza intego zamahugurwa: aho gutandukanya ibiturangaza nka Wav2Vec 2.0, HuBERT ikoresha intambwe yo guhuza interineti (k-bisobanura) hejuru y amajwi kugirango igabanye buri kintu kigufi ikirango cyihariye. Moderi noneho ihisha ibice byamajwi ikamenya guhanura ibirango bya cluster kumurongo wihishe, ifata imvugo nkurukurikirane rwa pseudo-fonema. By'umwihariko, HuBERT isubiramo: irongera ikusanya ikoresheje icyitegererezo cyayo cyanonosowe kandi ikongera ikongera, ikarushaho gukarishya ibice bigenewe. Uku kunonosora ibintu bitanga ibintu bikomeye birenze ASR, umuvugizi, nibipimo byamarangamutima nka SUPERB.

Ubushishozi

Ubwiza bwa HuBERT buri mu gukuramo ibisekuruza biva mu guhanura. Kwisubiramo hakiri kare ibintu byoroshye MFCC biranga k-bisobanura amasomo; nyuma yo gusubiramo ihuriro ryihishwa kuva murwego rwo hagati rwa Transformer layer, ikubiyemo amakuru akungahaye kuri fonetike. Kuberako icyitegererezo gikeneye gusa guhanura indangamuntu kumwanya wihishe, intego ziguma zihamye nubwo ihuriro ridatunganye, kureka urusobe rukiga imiterere ya acoustic nindimi zidafite inyandiko-mvugo.

Ingaruka z'Ingamba

Kugera no kugera

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Igiciro na bije

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Umuvuduko n'igipimo

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Kazoza ka HuBERT Kwiyobora Ijambo

HuBERT yabaye umusingi wa NLP idafite inyandiko, harimo nururimi ruvugwa rutanga imvugo iturutse mubice byizewe bidafite umwandiko wo hagati. Ibice byihishe bigaburira imvugo, guhinduranya amajwi, hamwe no guhinduranya imvugo. Tegereza uburyo bwa HuBERT bwerekana ibimenyetso kugirango ushigikire icyiciro cyikigereranyo cyururimi rwamajwi rufata imvugo nkuko LLMs ifata inyandiko, wongeyeho gukomeza kwanduzanya hamwe nururimi rwindimi nyinshi kandi rwinshi.

Gushyira mu bikorwa Isi

Gukora imvugo yihariye yerekana imvugo idafite imvugo-yerekana imvugo

Gutegura ibintu bikomeye bikuramo ibintu neza neza neza kubutunzi buke ASR

Gutwara amajwi guhindura no guhindura imvugo-ijambo ukoresheje ibice byize

Gukora nkumugongo wapimwe murwego rwa SUPERB rwimirimo yo kuvuga

Ingaruka & Kurinda

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the HuBERT Self-Supervised Speech quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Kwigenzura wenyine

Ibibazo bikunze kubazwa

What is HuBERT Self-Supervised Speech?

HuBERT (Byihishe-Igice BERT) ni Meta AI yerekana imvugo yigenga yigenga yiga mu guhanura ibice byamajwi bikusanyirijwe mubice byapimwe, uburyo bwa BERT. Nibyingenzi kuberako intego zayo zishingiye kumurongo akenshi zirusha uburyo butandukanye bwo kumenyekanisha no kumenyekanisha imirimo yo hasi.

Nigute HuBERT itanga intego igerageza guhanura mugihe cy'amahugurwa?

HuBERT ihuriro ryamajwi yerekana amajwi (ikoresheje k-uburyo) mubice byihariye byihishe kandi irahanura ibyo birango bya cluster kubipfundikizo.

Ni ubuhe bwoko bw'inyandiko buzwi bwahumekeye HuBERT gahunda yo guhugura-guhanura?

HuBERT (Hidden-Unit BERT) itira BERT intego yo guhanura-guhanura, kuyikoresha mubice bitandukanya imvugo aho kwerekana ibimenyetso.

Nigute HuBERT itezimbere ibirango byayo hejuru yimyitozo ikurikirana?

HuBERT isubiramo: nyuma izenguruka cluster ikize cyane ibintu byihishe uhereye kumurongo wikitegererezo, bikarishye intego za pseudo-phoneme.

Ni ibihe bintu bikunze guhurizwa hamwe muri HuBERT ya mbere cyane?

Itangiriro rya iterateri yibanze yibanze ya MFCC; nyuma yo gusubiramo ukoreshe Transformer-layer igaragara.

Kuki HuBERT ishobora kwiga imiterere yingirakamaro nubwo ihuriro ryayo ridatunganye?

Kuberako intego ari uguhitamo gusa indangamuntu zahawe indangamuntu zipfundikijwe, umurimo ukomeza kwigishwa kandi uhoraho nubwo urusaku rwuzuye urusaku.