Audio AI JAGORA

Jasper da QuartzNet ASR

Jasper da QuartzNet sune samfurin gane magana na ƙarshe-zuwa-ƙarshe na NVIDIA, tare da QuartzNet kasancewar ƙaramin ƙarami, ingantaccen tsarin Jasper.

Dubawa

Jasper da QuartzNet sune samfurin gane magana na ƙarshe-zuwa-ƙarshe na NVIDIA, tare da QuartzNet kasancewar ƙaramin ƙarami, ingantaccen tsarin Jasper. Suna da mahimmanci don nuna yadda ake samun daidaito mai ƙarfi tare da ƴan sigogi masu nisa, manufa don turawa.

Jasper da QuartzNet ASR suna zaune a cikin ayyukan aiki na audio-AI wanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai.

Zurfafa nutsewa

Jasper (Wani Mai Gane Magana kawai), wanda NVIDIA ta saki a cikin 2019, cibiyar sadarwa ce mai zurfi ta 1D, har zuwa yadudduka 54, wanda ke tsara fasalin mel-spectrogram zuwa haruffa ta amfani da asarar CTC. Ya gabatar da raƙuman haɗin kai don haka gradients suna gudana cikin tsafta ta cikin tari mai zurfi sosai. QuartzNet, wanda aka saki a wannan shekarar, ya kiyaye tsarin toshewar Jasper amma ya maye gurbin daidaitattun juzu'ai tare da rabe-raben tashoshi na lokaci, yana raba kowane tacewa zuwa juzu'i mai zurfi na ɗan lokaci da matakin haɗakar tashoshi mai ma'ana. Wannan ƙididdiga ya rage ma'auni daga Jasper kusan miliyan 333 zuwa kusan miliyan 19 yayin da ya dace da daidaito akan Librispeech. Dukansu suna jigilar kaya a cikin kayan aikin NeMo na NVIDIA kuma ana sauraron su don horarwar GPU cikin sauri da kuma ainihin lokacin, yana mai da su shahararrun tubalan ginin don samarwa ASR.

Fahimtar Fasaha

Ingancin QuartzNet ya fito ne daga rikice-rikicen lokaci-tashar, ra'ayi iri ɗaya a bayan MobileNet. Juyin juya hali na 1D na yau da kullun yana haɗa lokaci da tashoshi tare, yana biyan K sau C-in lokutan C-fita nauyi. Raba shi cikin juzu'i mai zurfi akan lokaci tare da juzu'i mai ma'ana 1x1 akan tashoshi yana rage sigogi zuwa K sau C da C-in sau C-out. An tattara shi a cikin ragowar tubalan kuma an horar da shi tare da CTC, wannan yana ba da daidaito kusa-Jasper a ɗan ƙaramin girman samfurin da ƙididdigewa.

Jagorar Jasper da QuartzNet ASR

Jasper da QuartzNet sune samfurin gane magana na ƙarshe-zuwa-ƙarshe na NVIDIA, tare da QuartzNet kasancewar ƙaramin ƙarami, ingantaccen tsarin Jasper. Suna da mahimmanci don nuna yadda ake samun daidaito mai ƙarfi tare da ƴan sigogi masu nisa, manufa don turawa. Jasper da QuartzNet ASR suna zaune a cikin ayyukan aiki na audio-AI wanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai. Don gina zurfin fahimta, bi Jasper da QuartzNet ASR a matsayin samfurin aiki, ba nau'i ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da kuma raba abin da tsarin zai iya yi a dogara daga abin da har yanzu yana buƙatar yanke shawara na gwani.

A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Jasper da QuartzNet ASR suna kula da inganci, jinkiri, da yarda a matsayin daidaitattun sassa na dabarun turawa. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A lokaci guda, rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar Jasper da QuartzNet ASR

Rabe-raben juzu'i na QuartzNet ya jagoranci kai tsaye zuwa Citrinet na NVIDIA da samfuran Conformer da ake amfani da su sosai, waɗanda ke ƙara hankalin kai don ɗaukar mahallin duniya tare da rikice-rikice na gida. Yi tsammanin ci gaba da motsi zuwa ga haɗaɗɗun juzu'i-da-hankali gine-gine da masu gyarawa (RNN-T) don yawo. Babban darasi, ingantaccen juzu'i don ƙwanƙwasa da turawa na ainihi, ya kasance tsakiya yayin da ASR ke turawa kan wayoyi, motoci, da na'urori masu haɗawa.

Aiwatar da Gaskiyar Duniya

Rubutun lokaci na ainihi da mataimakan murya da aka tura akan NVIDIA GPUs ta kayan aikin NeMo

Edge da saka ASR inda ƙaramin sawun QuartzNet ya dace da na'urori masu ƙuntata ƙwaƙwalwar ajiya

Ingantattun wuraren bincike na QuartzNet da aka riga aka horar don takamaiman ƙamus na yanki kamar likitanci ko sharuddan doka

Ƙididdigar cibiyar kira tana rubuta manyan kundin sauti cikin sauri da farashi mai inganci

Hanyoyin Aiwatarwa

Jasper da QuartzNet ASR a aikace

Rubutun lokaci na ainihi da mataimakan murya da aka tura akan NVIDIA GPUs ta kayan aikin NeMo.

Rubutun lokaci na ainihi da mataimakan murya da aka tura akan NVIDIA GPUs ta Ƙungiyoyin kayan aikin NeMo yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.

Jasper da QuartzNet ASR a aikace

Edge da saka ASR inda ƙaramin sawun QuartzNet ya dace da na'urori masu ƙuntata ƙwaƙwalwar ajiya.

Edge da saka ASR inda ƙananan sawun QuartzNet ya dace da na'urori masu ƙuntata ƙwaƙwalwar ajiya Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da kuma bin diddigin nasarorin yawan aiki da ƙimar kuskure akan lokaci.

Jasper da QuartzNet ASR a aikace

Kyakkyawan daidaitawa da aka riga aka horar da wuraren bincike na QuartzNet don ƙayyadaddun ƙamus na yanki kamar likitanci ko sharuddan doka.

Kyawawan gyare-gyaren wuraren bincike na QuartzNet don ƙayyadaddun ƙamus na yanki kamar likitanci ko sharuɗɗan shari'a Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.

Jasper da QuartzNet ASR a aikace

Ƙididdigar cibiyar kira tana rubuta manyan kundin sauti cikin sauri da farashi mai inganci.

Ƙididdigar cibiyar kira da ke rubuta manyan juzu'i na sauti cikin sauri da farashi mai inganci Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da farashi na kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.

!

Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.

!

Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.

Taswirar Hanya

1

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Gwajin ingantattun masu magana daban-daban da yanayin baya.

Gwajin ingantattun masu magana daban-daban da yanayin baya. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike