Conformer Architecture
The Conformer bụ ngọngọ netwọk akwara nke na-ejikọta convolution na nlebara anya onwe ya, na-ewere ma usoro ụda mpaghara mara mma yana ọnọdụ ogologo ogologo n'otu oyi akwa.
Nchịkọta
It became the de facto standard encoder for state-of-the-art speech recognition.
Ime miri emi
Nke __AIU_PROTECTED_11_ webatara na 2020, Conformer zara otu esemokwu dị mkpa na ịme ngosi ọdịyo: nlebara anya onwe onye (site na Transformers) dị oke mma na ọnọdụ ụwa mana adịghị ike na mpaghara, ụkpụrụ mara mma nke na-amata ụda ekwentị, ebe convolutions karịrị mpaghara mana ọ na-agba mbọ ịhụ ogologo ogologo okwu. Ihe mgbochi Conformer na-ejikọta ha ọnụ na imewe 'sandwichi': ọkara nzọụkwụ nri-n'ihu modul, mgbe ahụ, a multi-isi onwe modul nlebara anya, mgbe ahụ a convolution modul, mgbe nkera nkera nke abụọ-nzọụkwụ nri-n'ihu modul, na oyi akwa normalization na fọdụrụ njikọ niile. Modul convolution na-eji convolutions nwere ike kewaa miri emi yana nkeji ahịrị kwụ ọtọ. Site n'ịhapụ nhazi mpaghara na nke zuru ụwa ọnụ n'ime ngọngọ ọ bụla, Conformer encoders na-ebelata ọnụego njehie okwu karịa ihe ntụgharị dị ọcha ma ọ bụ usoro ntụgharị okwu dị ọcha na akara ngosi dị ka LibriSpeech.
Nghọta nka nka
Ihe nrụnye 'Macaron' mbinye aka na-ekpuchi nlebara anya na ntụgharị n'etiti ọkwa abụọ na-aga n'ihu, nke ọ bụla na-enye ihe fọdụrụnụ nke ọkara (ihe 0.5), nke sitere na nyocha nke ụzọ abụọ Transformer FFN. Modul convolution a na-ejikọkarị mgbanwe ntụgharị uche nwere mgbanaka GLU, mgbagha miri emi, nhazi nhazi, mgbake Swish, yana ntụgharị ntụgharị ikpeazụ - ụzọ dị mma iji gosipụta ọnọdụ mpaghara na-enweghị mgbawa oke.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke Conformer Architecture
Ndị na-eme mgbanwe na-eje ozi ugbu a dị ka ihe ngbanwe ọkpụkpụ azụ maka transducer na CTC/ntị ASR, na imewe agbasawo na ntụgharị okwu, njirimara ọkà okwu, na nchọpụta ihe omume ọdịyo. Nchọpụta na-arụsi ọrụ ike na-eme ka nlebara anya maka ogologo ọdịyo (nleba anya n'ahịrị na chunked maka mgbasa ozi), na-emegharị Conformers maka iji ngwaọrụ, ma jikọta ha na ọzụzụ ọzụzụ onwe onye na-elekọta. Ndị dị iche iche dị ka Squeezeformer na Conformer dị mma na-akwalite ahịa-mgbakọ nke ziri ezi n'ihu.
Mmejuputa n'ezie n'ụwa
Na-eje ozi dị ka koodu nzuzo na mmepụta ASR sistemu n'azụ ndị enyemaka olu na dictation
Ụdị ntụgharị asụsụ okwu ike nke na-edegharị na ịtụgharị asụsụ a na-asụ na njedebe na njedebe
Ọkpụkpụ azụ maka nkwenye ọkà okwu na idepụta akwụkwọ, na-achọpụta onye kwuru mgbe ọ nọ na nzukọ
Mmemme ọdịyo na nhazi ụda, dị ka ịchọpụta mkpu, okwu ma ọ bụ egwu na iyi
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Conformer Architecture quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
DeepSpeech Architecture
Ajụjụ a na-ajụkarị
What is Conformer Architecture?
The Conformer bụ ngọngọ netwọk akwara nke na-ejikọta convolution na nlebara anya onwe ya, na-ewere ma usoro ụda mpaghara mara mma yana ọnọdụ ogologo ogologo n'otu oyi akwa. Ọ ghọrọ ihe ngbanwe ọkọlọtọ de facto maka njirimara okwu ọgbara ọhụrụ.
Kedu usoro abụọ nke Conformer architecture jikọtara n'otu ngọngọ?
The Conformer fuses convolution (maka ụkpụrụ mpaghara) na nlebara anya onwe ya (maka ọnọdụ ụwa) n'ime ngọngọ ọ bụla.
Gịnị mere ijikọta mgbagwoju anya na nlebara anya ji baa uru karịsịa maka ikwu okwu?
Mgbanwe dị iche iche na-eme nke ọma na njirimara mpaghara mara mma nke na-akọwapụta fọnịm, ebe nlebara anya onwe onye na-adabere n'otú okwu ahụ dum; Conformer na-enweta ma.
Kedu ihe bụ usoro 'Macaron' ma ọ bụ Sanwichi nke ngọngọ Conformer?
The Conformer na-edobe nlebara anya onwe na modul convolution n'etiti modul abụọ na-ebuga nri, nke ọ bụla etinyere ya na ihe mpụta nwere ọkara.
Kedu nzukọ webatara Conformer, na kedu afọ?
Ndị nyocha Google webatara Conformer n'afọ 2020 wee bụrụ ngwa ngwa ihe njiri mara okwu.
Kedu ihe modul convolution dị n'ime Conformer na-agụnyekarị?
Modul convolution a na-eji nkeji ahịrị kwụ ọtọ, ntụgharị omimi miri emi, nhazi ogbe, yana ịgbalite Swish, na-ejedebe na ntụgharị ntụgharị ọzọ.