Ubuyobozi bwa Audio AI

NVIDIA Riva na Ijambo rya NeMo

NVIDIA Riva ni GPU yihuta ya SDK yo kuvuga umusaruro AI (ASR, TTS, hamwe nubuhinduzi), naho NeMo nigitabo gifungura isoko yo guhugura no guhuza neza imiterere yibanze.

Incamake

NVIDIA Riva ni GPU yihuta ya SDK yo kuvuga umusaruro AI (ASR, TTS, hamwe nubuhinduzi), naho NeMo nigitabo gifungura isoko yo guhugura no guhuza neza imiterere yibanze. Hamwe na hamwe bareka abitezimbere bakubaka byihuse, byemewe amajwi akoreshwa kubikoresho bya NVIDIA.

NVIDIA Riva na NeMo Speech bicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

NeMo (Neural Modules) ni NVIDIA ifungura-isoko ya PyTorch yo kubaka AI iganira. Kohereza ibyitegererezo byateganijwe kugirango bimenyekanishe mu buryo bwikora (ASR), inyandiko-ku-mvugo (TTS), n'imirimo y'ururimi karemano, byateguwe nka 'modules modules' byongeye gukoreshwa ushobora guhuza neza amakuru yawe bwite. Riva ni uruhande rwoherejwe: ipakira moderi nziza cyane inyuma ya seriveri ya gRPC, ikoresheje TensorRT hamwe na Triton Inference Server kugirango ikubite ubukererwe buke mubipimo. Ubusanzwe akazi gahugura cyangwa gahuza icyitegererezo muri NeMo, kyohereza muburyo bwa Riva, hanyuma ikagikora mugihe cyo kwandukura cyangwa kugihe. Riva ishyigikira kumenyekanisha hamwe nijambo-urwego rwigihe, amajwi ya TTS, amajwi ya disikuru, hamwe nindimi nyinshi, byose byahujwe kugirango bikore neza kuri NVIDIA GPUs.

Ubushishozi

Umuvuduko wa Riva uva mugukora moderi hamwe na TensorRT no kuyikorera binyuze muri Triton, ihuza intungamubiri, ikoresha ivanze-risobanutse (FP16 / INT8), kandi ikanasaba ibyifuzo icyarimwe. Moderi ya ASR nka Conformer-CTC cyangwa Parakeet yerekana amajwi mubice bito mugihe ikomeza imiterere, itanga inyandiko-mvugo igice muri milisegonda mirongo. Imiyoboro ya TTS ihuza moderi ya acoustic (urugero, FastPitch) hamwe nijwi ryumvikana (urugero, HiFi-GAN) kugirango ritange imiyoboro yihuta kuruta igihe nyacyo kuri GPU imwe.

Kumenya NVIDIA Riva na NeMo Imvugo

NVIDIA Riva ni GPU yihuta ya SDK yo kuvuga umusaruro AI (ASR, TTS, hamwe nubuhinduzi), naho NeMo nigitabo gifungura isoko yo guhugura no guhuza neza imiterere yibanze. Hamwe na hamwe bareka abitezimbere bakubaka byihuse, byemewe amajwi akoreshwa kubikoresho bya NVIDIA. NVIDIA Riva na NeMo Speech bicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata NVIDIA Riva na NeMo Speech nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha NVIDIA Riva na NeMo Speech ifata ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza ha NVIDIA Riva na NeMo Imvugo

NVIDIA irasunika Riva na NeMo kugana imvugo nini, indimi nyinshi zerekana imvugo no kwishyira hamwe hamwe na LLM ishingiye kubakozi bafasha amajwi arangira. Tegereza ibintu bikize cyane (kuzamura ijambo, amajwi yihariye kuva muminota yamakuru), urusaku rwiza-ibidukikije bikomeye, hamwe no kohereza amakuru hagati ya GPUs kugeza kubikoresho nka Jetson. Mugihe NeMo igenda ihindagurika hamwe nicyitegererezo kibyara umusaruro, umurongo uri hagati yo kumenyekanisha imvugo, guhindura, no gutekereza kubitekerezo bizakomeza guhurizwa mumiyoboro ihuriweho nigihe nyacyo.

Gushyira mu bikorwa Isi

Igihe nyacyo cyo guhamagarira-kwandikirana hamwe na agent nzima ifasha yanditseho abakiriya bahamagara hamwe nijambo-urwego rwigihe

Kubaka amajwi yihariye ya TTS kumufasha wungirije muburyo bwiza bwo gutunganya FastPitch muri NeMo kumasaha make yafashwe

Kwandika neza no gusobanura imvugo kubiganiro bya videwo cyangwa ibyabaye kuri NVIDIA GPUs

Kuringaniza neza moderi ya ASR ikora kumurongo wihariye wubuvuzi cyangwa amategeko yemewe ukoresheje NeMo, hanyuma ukayikorera ukoresheje Riva

Uburyo bwo Gushyira mu bikorwa

NVIDIA Riva na NeMo Imvugo mubikorwa

Igihe nyacyo cyo guhamagarira-kwandikirana hamwe na agent nzima ifasha yanditseho abakiriya bahamagara hamwe nijambo-urwego rwigihe.

Igihe nyacyo cyo guhamagarira-kwandikirana hamwe na agent ubafasha bifasha kwandika abakiriya bahamagaye hamwe nijambo-urwego rwigihe cyamakipe Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

NVIDIA Riva na NeMo Imvugo mubikorwa

Kubaka amajwi yihariye ya TTS amajwi kumufasha wukuri ukoresheje neza FastPitch muri NeMo kumasaha make yafashwe.

Kubaka amajwi yihariye ya TTS kumufasha wungirije muburyo bwiza bwo gutunganya FastPitch muri NeMo kumasaha make yafashwe amajwi Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

NVIDIA Riva na NeMo Imvugo mubikorwa

Kwandika neza no gusobanura imvugo kubiganiro bya videwo cyangwa ibyabaye kuri NVIDIA GPUs.

Kwandika neza no guhindura imvugo kubiganiro bya videwo cyangwa gutambutsa ibyabaye kuri NVIDIA GPUs Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi agakurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

NVIDIA Riva na NeMo Imvugo mubikorwa

Kuringaniza neza Moderi ya ASR kumurongo wihariye wubuvuzi cyangwa amategeko yemewe ukoresheje NeMo, hanyuma ukayikorera binyuze muri Riva.

Kuringaniza neza icyitegererezo cya ASR kumurongo wihariye wubuvuzi cyangwa amategeko yemewe ukoresheje NeMo, hanyuma ukayikorera binyuze mumakipe ya Riva mubisanzwe ubona ibisubizo byiza mugihe basobanuye ibipimo byujuje ubuziranenge imbere, bagakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi bagakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi