NVIDIA Riva ak NeMo
NVIDIA Riva SDK la bu gaaw ci GPU ngir defar kàddu IA (ASR, TTS, ak tekki làkk), fekk NeMo mooy jumtukaayu open-source ngir tàggat ak defar model yi ci suuf.
Résumé
Together they let developers build fast, customizable voice applications that run on NVIDIA hardware.
Plongeur bu xóot
NeMo (Module Neural) mooy kaadar PyTorch bu NVIDIA ngir tabax IA buy waxtaan. Dafay yónnee ay model yuñ tàggat bu njëkk ngir xàmmee kàddu yi ci saa si (ASR), bind-ci-kaddu (TTS), ak liggéeyi làkk wiñ nàmp, ñu defaree ko ni 'module neuronal' yuñ mëna jëfandikoowaat, nga mën ko gëna defar ci say done. Riva mooy wàllu jëfandikoo gi: dafay ëmb ay model yuñ gëna defar ci ginnàaw serwëru gRPC buy daw, di jëfandikoo TensorRT ak Serwëru Inference Triton ngir am latency bu woyof ci escalier. Liggéey bu ñuy xam mooy tàggat wala méngale ab model ci NeMo, yóbbu ko ci formaa Riva, ba noppi jëfandikoo ko ngir transkripsioŋ wala synthese ci jamono dëgg. Riva dafay jàppale xàmmee streaming ak timestamps ci niveau baat, baat TTS neural, diarization waxkat, ak làkk yu bari, ñoom ñépp ñu ngi aju ci dox bu baax ci NVIDIA GPUs.
Gis-gis xarala
Gaawaayu Riva mingi aju ci dajale ay model ak TensorRT ba noppi di leen jox Triton, mooy boole kernel yi, jëfandikoo njubte bu wuute (FP16/INT8), ak boole ay laaj yuy boole ci anam wu dinaamik. Modèle ASR yu melni Conformer-CTC wala Parakeet dañuy stream audio ci ay pàcc yu ndaw boole ci tëye muy tekki, defar ay transkripsioŋ yu xaaj ci fukki milisegond. Tuyo TTS yi dañuy boole xeetu akustik (lu melni, FastPitch) ak vocoder neuronal (lu melni, HiFi-GAN) ngir defar forme onde yu gëna gaaw ci benn GPU.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu NVIDIA Riva ak NeMo
NVIDIA mingi puus Riva ak NeMo ci xeetu kàddu yu gëna yaatu, yu gëna bari làkk, ak lëkkaloo bu gëna dëgër ak ndawu liggéey yu LLM ngir jàppale baat ci njeexte ba ci njeexte. Xaarandil gëna riis ci personaalisasioŋ (baatu boosting, baat yuñ personaaliseer ci ay simili yu done), robustness environnement bu gëna am bruit, ak jëfandikoo giy span GPUs data-center ba ci aparey yu melni Jetson. Bi NeMo di jëm kanam ci wetu xeetu generatif yi, dig wi dox diggante xàmmee kàddu, tekki làkk, ak xalaat ci waxtaan dina wéy di gëna fës ci pipeline yuñ boole ci jamono dëgg.
Doxal ci àdduna dëgg
Transkripsiyoŋu santaru woote ci jamono dëgg ak ndimbalu ndawu liggéey biy bind wootu kiliyaan yi ci timbre waxtu ci niveau baat
Tabax ay baat TTS yu màrk ngir assistant virtuel ci defar FastPitch ci NeMo ci ay waxtu enregistrement yu néew
Sous-titre ak tekki kàddu ngir ndaje wideo wala xew-xew yuy dawal ci NVIDIA GPUs
Defar ab xeetu Conformer ASR ci vocabulaire medikaal wala yoon bu jëm ci domen bi jëfandikoo NeMo, ba noppi nga joxe ko jaaraleko ci Riva
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the NVIDIA Riva and NeMo Speech quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
PESQ ak STOI Kalite Kaddu
Laaj yi ñuy faral di laaj
What is NVIDIA Riva and NeMo Speech?
NVIDIA Riva SDK la bu gaaw ci GPU ngir defar kàddu IA (ASR, TTS, ak tekki làkk), fekk NeMo mooy jumtukaayu open-source ngir tàggat ak defar model yi ci suuf. Ñoom ñaar ñu ngi may developpeur yi ñu defar aplikaasioŋu baat bu gaaw te ñu mëna tànn di dox ci hardware NVIDIA.
Lan mooy wuutale bu njëkk bi am ci digganté NeMo ak Riva?
NeMo mooy jumtukaayu open-source bi ngir tabax ak defar ay modeli làkk ak kàddu, waaye Riva dafay ëmb model yooyu ngir jëfandikoo ay produit yu néew latency.
Ban ñaari xaralay NVIDIA la Riva sukkandikoo ngir mëna am inference bu woyof?
Riva dafay dajale ay model ak TensorRT ngir gëna mëna jëfandikoo GPU ba noppi di leen jox jaaraleko ci Serveur Inference Triton, mooy yonnee batching ak concurrence.
Ci gasoduc Riva TTS, lan mooy wareefu vocoder bu melni HiFi-GAN?
Benn xeetu akustik bu melni FastPitch dafay wax luy waaja am ci spectrogram ci mbind, ba noppi ab vocoder neural bu melni HiFi-GAN dafay soppi màndarga yooyu ci jëmmu onde bu mujj bi ñuy dégg.
Lan mooy 'streaming' ASR ci Riva?
Xamme streaming dafay liggéey audio ci ay pàcc yu ndaw ba noppi génne ay resultaa ci diir bu gàtt, du xaar wax ji yépp jeex.
Lan mooy misaalu personaalisasioŋ bi NeMo mëna def ngir modeli kàddu yi?
NeMo dafay may developpeur yi ñu mëna defar model yiñ njëkka tàggat ci seeni done, lu ci melni méngale model ASR ngir xàmmee terminologie medikaal wala yoon buñ jagleel.