Wav2Vec 2.0
Wav2Vec 2.0 shine Meta Tsarin magana mai kulawa da kai wanda ke koyan ƙwaƙƙwaran sauti mai jiwuwa daga ɗanyen rikodi mara lakabi.
Dubawa
It matters because it slashed the amount of transcribed audio needed to build accurate speech recognizers, unlocking ASR for low-resource languages.
Zurfafa nutsewa
Facebook ne ya gabatar da shi (Meta) AI a cikin 2020, Wav2Vec 2.0 sun magance ƙwanƙwasa ƙwanƙwasa a fahimtar magana: sautin da aka lakafta yana da karanci kuma yana da tsada, yayin da ɗanyen sauti yake da yawa. Samfurin ya fara horar da dubban sa'o'i na maganganun da ba a lakafta su ta hanyar koyan cika sassan siginar da abin rufe fuska, yana gina ingantaccen fahimtar tsarin sauti. Bayan haka kawai an daidaita shi akan ƙaramin adadin da aka rubuta. Shahararren, tare da kawai mintuna 10 na sautin sauti tare da babban horo na farko, ya kai ƙimar kuskuren kalma mai amfani akan ma'aunin LibriSpeech. Wannan girke-girke ya ba da demokraɗiyya ASR, yana ba da damar ingantaccen rubutu don harsuna da yarukan da ba su da manyan bayanai masu alaƙa.
Fahimtar Fasaha
Wav2Vec 2.0 yana ciyar da danyen igiyar igiyar ruwa ta hanyar sigar CNN mai nau'i-nau'i da yawa, sa'an nan kuma ya rufe abin rufe fuska. Mai Canjawa yana karanta mahallin abin rufe fuska kuma dole ne ya gano daidaitaccen adadi na kowane yanki mai rufe fuska daga saitin masu raba hankali, ta amfani da asara mai bambanci. Littafin littafin da aka koya yana ɓatar da ci gaba da sautin sauti zuwa ƙayyadaddun sassan magana, yana ba da madaidaitan aikin maƙasudin maƙasudan ƙima.
Dabarun Tasiri
Shiga ku isa
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.
Kudin da kasafin kuɗi
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.
Gudu da sikelin
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.
Makomar Wav2Vec 2.0
Wav2Vec 2.0 ya zurfafa zurfafa zurfafa zurfafan nau'ikan maganganun magana masu kulawa da kansu da kuma XLS-R masu yawan harsuna da yawa, waɗanda suka mamaye harsuna 128. Hanyar tana haɗuwa zuwa ga maƙallan maganganun magana na duniya waɗanda ke canjawa zuwa ganewa, fassara, gano motsin rai, da ayyukan lasifika daga tushe da aka riga aka horar. Yi tsammanin ci gaba da fa'ida don ƙaƙƙarfan harshe da ƙarancin albarkatu, da ƙarin haɗakar da sifofin sauti masu sarrafa kai cikin tsarin multimodal waɗanda ke haɗa gwiwa kan magana, rubutu, da sauran sigina.
Aiwatar da Gaskiyar Duniya
Gina masu gane magana don ƙananan yarukan albarkatu tare da mintuna kawai na sauti da aka rubuta
Gabatar da mai rikodin sauti na duniya daga baya an daidaita shi don kwafin kiran waya
Cire fasalin magana don tsarin fahimtar motsin rai ko lasifika
Ƙaddamar da samfurin XLS-R na harsuna da yawa wanda ke fassara cikin harsuna sama da 100
Hatsari & Tsare-tsare
Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.
Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.
Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.
Taswirar Hanya
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.
Gwajin ingantattun masu magana daban-daban da yanayin baya.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Wav2Vec 2.0 quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Neural Vocoders
Tambayoyin da ake yawan yi
What is Wav2Vec 2.0?
Wav2Vec 2.0 shine Meta Tsarin magana mai kulawa da kai wanda ke koyan ƙwaƙƙwaran sauti mai jiwuwa daga ɗanyen rikodi mara lakabi. Yana da mahimmanci saboda ya rage adadin sautin da aka rubuta da ake buƙata don gina ingantattun masu gane magana, buɗe ASR don ƙananan harsunan albarkatu.
Wace babbar matsala a cikin fahimtar magana aka tsara Wav2Vec 2.0 don magance?
Wav2Vec 2.0 yana rage dogaro da sauti mai tsadar gaske ta hanyar horarwa akan ɗimbin magana mara lakabi da farko.
Wane irin makasudin koyo ne Wav2Vec 2.0 ke amfani da shi yayin horo?
Yana rufe faifai na latent vectors audio kuma yana amfani da asara mai bambanci don ɗaukar madaidaicin adadin naúrar tsakanin masu raba hankali.
Wane bangare ne ya fara aiwatar da danyen igiyar ruwa a cikin Wav2Vec 2.0?
Tarin yadudduka masu jujjuyawa suna ɓoye sigar ƙaƙƙarfan ƙaƙƙarfan ƙaƙƙarfan raƙuman ruwa zuwa ɓoyayyiyar sifa kafin rufe fuska da Mai Canjawa.
Yaya ɗan ƙaramin sauti mai lakabin Wav2Vec 2.0 ya shahara ya buƙaci isa daidaito mai amfani akan LibriSpeech?
Tare da babban horo na farko tare da mintuna 10 kawai na bayanan da aka yiwa alama, ya sami ƙimar kuskuren kalmomi da ban mamaki, yana nuna ingancin alamar.
Menene aikin littafin lambar koyo a cikin Wav2Vec 2.0?
Littafin kundin yana ƙididdige ci gaba da wakilci zuwa ƙayyadaddun saiti na raka'a masu hankali, yana ba da maƙasudi don maƙasudin maƙasudi.