Soppi baat
Soppi baat dafay soppi kàddu yi benn nit bind, suko defee mu melni keneen moo ko wax, boole ci baña soppi kàddu yi ak waxtu wiñ ko bindee.
Résumé
It is the audio equivalent of a face swap, changing who you hear without changing what is said.
Plongeur bu xóot
Soppi baat (VC) dafay jël audio bi bawoo ci baat bi, daal di koy soppi ci baat biy wax, ba noppi baña yàq ëmbiitu làkk wi ak ritm bi. Li gëna am solo mooy ñu tàqale li ñuy wax (ëmbiit li) ak ki koy wax (dàntite ki wax, ñu jàpp ko ci timbre ak màndarga ton), ba noppi boole ëmbiitu xët wi ak dàntite ki ñuy wax. Sistem yu yàgg yi dañu soxla enregistrement paralel bu ñaari waxkat yi di wax benn frase, waaye anam yu bees yi duñu paralel te dañuy faral di nekk zero-shot, di klone baat bu bees ci ay segond yu néew ci audio royuwaay. Design yiñ gëna xam dañuy jëfandikoo autoencoder yu am ay jafe-jafe ci joxe leeral (lu melni AutoVC), man-mani ëmbiit yu ñuy saytu seen bopp, wala reso yuy xeex lu melni CycleGAN-VC. Suko defee vocoder neuronal bi dafay soppi màndarga yiñ soppi def ko forme onde.
Gis-gis xarala
Xolu VC mooy disentanglement: tàqale ëmbiit li moom boppam ci waxkat bi ak ëmbiit liy waxkat bi. AutoVC dafay dooleel lii ak benn bottleneck bu dayo bu baax buy tënk dàntite bi, bàyyi ëmbiit li kese, ba noppi sart decodage ci vecteur oparlër biñ bëgga. Yeneen pexe yi dañuy génne ëmbiit li ci model yu ñuy saytu seen bopp (lu melni yunit HuBERT) wala ñu jëfandikoo posteriorgram fonetik. CycleGAN-VC lu moy loolu dafay jàng mapping diggante ñaari baat yu amul done yu paralel, jëfandikoo cycle-consistence suko defee tukkib dellu ak ñibbi di delloosi orginaal bi.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu soppi baat
Coppite baat mingi dem ci saasi, cloning zero-shot bu dëggu ci ay segond audio, streaming ci jamono dëgg ngir woote en direct ak jeu, ak tàqale bu gëna baax ci accent, yëg-yëg, ak dàntite suko defee ku nekk mëna soppali boppam. Dafay dige ni dina am kàddu yu bees ngir nit ñi ñàkk kàddu, ak dubbing bu jaar yoon ci làkk yi. Ndax benn xarala bi dafay may njuuj njaaj ak niru ak nit, xaaral yokkute bu méngoo ci watermarking audio, gis deepfake, ak lisence baat bu sukkandiko ci deggoo.
Doxal ci àdduna dëgg
Defaraat baat buy sone bu baax ngir nit ñi ñàkk seen baat ndax feebar, jëfandikoo enregistremaa yu yàgg yi
Dubbing filmu ngir personage bi mëna am baat bu wuute ci làkk yu bari
Xaarandi waxkat yi ci enregistrement yu sensitif ci weccoo seen baat te baña yàq kàddu yi
May gamers yi ak streamers yi wax ci saasi ci baat personage buñu tann ci jamono dëgg
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Voice Conversion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Gis liggéeyu baat
Laaj yi ñuy faral di laaj
What is Voice Conversion?
Soppi baat dafay soppi kàddu yi benn nit bind, suko defee mu melni keneen moo ko wax, boole ci baña soppi kàddu yi ak waxtu wiñ ko bindee. Audio bi dafay nuru face swap, di soppi ki ngay dégg te doo soppi li ñuy wax.
Lan mooy soppi baat ci enregistrement?
Soppi baat dafay soppi dàntite waxkat bi (timbre ak màndarga baat bi) boole ci baña bàyyi kàddu yu njëkk ya ak waxtu wiñ ko bindee.
Ban kàttan core mooy may sistem bi mu weccoo baat ci di tëye kàddu yi?
VC dafay tàqale li ñuy wax (ëmbiit li) ak ki ko wax (dàntite waxkat bi), ba noppi boolewaat ëmbiitu cosaan bi ak dàntite ki ñuy wax.
naka lay def ba AutoVC di ñaax model bi mu dindi dàntite waxkat bi ci ëmbiit li?
AutoVC dafay jëfandikoo benn bottleneck bu dëgër buy forse dàntite waxkat bi, bàyyi ëmbiit li gëna bari, ba noppi sart decodage ci benn embedding waxkat biñ bëgga tànn.
Lan mooy wuutale setu done buy soppi baat bu 'paralel' ak bu 'paralel'?
VC parallel mingi soxla enregistrement yu méngoo ci benn wax ci ñaari waxkat yi, waaye pexe yu amul parallel mën nañu jàngee ci wax bu wuute, te loolu moo gëna am solo ngir dajale.
Luy soppi baat 'zero-shot'?
Zero-shot VC dafay yamale kàddukat yu bees yi ci jëfandikoo clip bu gàtt, te soxlawul ñu tàggataat model bi ci baat boobu.