Ubuyobozi bwa Audio AI

Ubwubatsi

Ihuza ni umuyoboro uhuza imiyoboro ihuza imyanzuro no kwiyitaho, ifata byombi amajwi meza yaho yerekana amajwi hamwe nintera ndende murwego rumwe.

2 min somaIbiherutse kuvugururwa

Incamake

It became the de facto standard encoder for state-of-the-art speech recognition.

Kwibira cyane

Byatangijwe na Google muri 2020, Umuhuza yashubije impagarara zingenzi muburyo bwo kwerekana amajwi: kwiyitaho (kuva muri Transformers) birakomeye murwego rwisi yose ariko bifite intege nke muburyo bwaho, bwerekana neza imiterere ya fonema, mugihe imyanzuro irenze mugace ariko igaharanira kubona mumagambo maremare. Ihuriro rya Conformer rihuza hamwe muburyo bwa 'sandwich': igice cyintambwe yo kugaburira-imbere-module, hanyuma imitwe myinshi-yo kwiyitaho module, hanyuma module yo kwemeza, hanyuma igice cya kabiri cyintambwe yo kugaburira-imbere module, hamwe nibisanzwe hamwe nibisigisigi bisigaye muri rusange. Module yo kwemeza ikoresha uburyo bwimbitse butandukanijwe hamwe numurongo wumurongo. Muguhuza ibikorwa byibanze hamwe nisi yose imbere muri buri gice, kodegisi ya kodegisi igabanya ijambo-ikosa igipimo cyinshi hejuru ya Transformer yuzuye cyangwa ibice byumvikanisha neza kubipimo nka LibriSpeech.

Ubushishozi

Umukono wa 'Macaron' ushyira ibitekerezo hamwe no kwemeza hagati y'ibiryo bibiri-bigaburira imbere, buri kimwe kigatanga igice kiremereye gisigara (ibintu 0.5), byatewe no gusesengura ibya Transformer FFN byombi. Module yo kwemeza mubisanzwe ibohesha imitekerereze ihindagurika hamwe na GLU ikora, kwemeza byimbitse, icyiciro gisanzwe, gukora Swish, hamwe nicyemezo cya nyuma cyo kwemeza - inzira nziza yo kwerekana imiterere yaho idaturika kubara ibipimo.

Ingaruka z'Ingamba

Kugera no kugera

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Igiciro na bije

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Umuvuduko n'igipimo

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Ejo hazaza h'ubwubatsi

Abahindura ubu bakora nka kodegisi ya kodegisi ya transducer na CTC / kwitondera ASR, kandi igishushanyo cyakwirakwiriye mu gusobanura imvugo, kumenyekanisha abavuga, no kumenya ibyabaye mu majwi. Ubushakashatsi bufatika bwerekana ibitekerezo byamajwi maremare (umurongo utondekanye kandi utondekanye kugirango utambuke), utandukanya abahindura imikoreshereze yibikoresho, kandi ubihuza no kwiyobora wenyine. Ibihinduka nka Squeezeformer hamwe nuburyo bunoze bwo gusunika gusunika ubunyangamugayo-na-kubara ibicuruzwa-bigera kure.

Gushyira mu bikorwa Isi

Gukora nka kodegisi mu gutunganya ASR sisitemu inyuma yabafasha amajwi hamwe nigitekerezo

Guha imbaraga imvugo yo guhindura imvugo isobanura kandi igahindura imvugo ivugwa iherezo

Inkingi yo kugenzura abavuga no gutandukanya, kumenya uwavuze iyo mu nama

Ibyabaye amajwi n'amajwi ashyirwa mubikorwa, nko kumenya gutabaza, imvugo, cyangwa umuziki mumugezi

Ingaruka & Kurinda

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Conformer Architecture quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Ubwubatsi bwimbitse

Ibibazo bikunze kubazwa

What is Conformer Architecture?

Ihuza ni umuyoboro uhuza imiyoboro ihuza imyanzuro no kwiyitaho, ifata byombi amajwi meza yaho yerekana amajwi hamwe nintera ndende murwego rumwe. Byahindutse kodegisi ya kodegisi yo kumenyekanisha imvugo igezweho.

Ni ubuhe buryo bubiri bwububiko bwa Conformer bukomatanya mugace kamwe?

Umuhuza ahuza imyanzuro (kubishushanyo mbonera) hamwe no kwiyitaho (kubijyanye nisi yose) muri buri gice.

Ni ukubera iki guhuza imyanzuro no kwitondera ari ingirakamaro cyane mu mvugo?

Imyanzuro iruta iyindi mvugo nziza itandukanya fonema, mugihe kwiyitaho-moderi biterwa no kuvuga byose; Uhindura abona byombi.

Ni ubuhe buryo bwa 'Macaron' cyangwa sandwich yuburyo bwo guhagarika?

Uhindura ashyiraho-kwiyitaho no kwemeza modules hagati yimyanya ibiri yo kugaburira-imbere, buri kimwe cyakoreshejwe hamwe nigice kiremereye gisigaye.

Nuwuhe muryango watangije Conformer, kandi nuwuhe mwaka?

Umuhinduzi yatangijwe nabashakashatsi ba Google muri 2020 kandi yahise aba kodegisi isanzwe imenyekanisha imvugo.

Ni ubuhe buryo bwo kwemeza imbere muri Conformer busanzwe bukubiyemo?

Module yo guhuza iminyururu ihinduranya icyerekezo hamwe numurongo wamazu, umurongo wimbitse, icyiciro gisanzwe, hamwe na Swish activation, bikarangirira mubindi byerekezo.