Nchịkọta AudioGen Ederede-gaa-Audio
AudioGen bụ ihe atụ Meta na-atụgharị nkọwa ederede ka ọ bụrụ ụda gburugburu ebe obibi na mmetụta ụda dị adị, dị ka 'nkịta na-agbọ ụja ka nnụnụ na-agbọkwa.' Ọ dị mkpa n'ihi na ọ na-ahapụ ndị okike ka ha wepụta ọdịyo na-abụghị okwu site na asụsụ dị larịị, ike na-efu ogologo oge site na AI na-emepụta ihe.
Ime miri emi
AudioGen, nke Meta AI weputara na 2022, bụ ihe nlere anya asụsụ nke na-ewepụta ọdịyo izugbe (mmetụta ụda, ihe nkiri, ụda anụmanụ na ihe) ozugbo site na mkpali ederede. N'adịghị ka usoro ederede gaa na-okwu, ọ na-elekwasị anya n'ụwa adịghị mma nke ụda ụbọchị. Ọ na-ebu ụzọ akpakọba ọdịyo raw ka ọ bụrụ usoro akara ngosi pụrụ iche site na iji codec neural (ụdị EnCodec autoencoder nwere ọnụọgụ vector fọdụrụnụ). Ụdị asụsụ Transformer na-amụtakwa ịkọ amụma ihe ngosi ọdịyo ndị a dabere na nkọwa ederede nke koodu ederede dị iche debere. Iji kwalite nghọta nhazi, ndị odee wee gwakọta ma chịkọta ihe nlele ọdịyo n'oge ọzụzụ ka ihe nlereanya ahụ wee mụta nchikota dị ka ụda na-agbakọta ọnụ. AudioGen mechara bụrụ akụkụ nke ọba akwụkwọ AudioCraft Meta n'akụkụ ụdị egwu MusicGen.
Nghọta nka nka
AudioGen nwere usoro abụọ. Nke mbụ, ihe autoencoder ọdịyo na-amụta ka a na-esepụta usoro ebili mmiri na iyi kọmpat nke akara ngosi na azụ. Nke abụọ, a zụrụ Transformer site n'ebumnuche nhazi asụsụ iji buo akara ngosi ọdịyo na-esote enyere akara ndị bu ụzọ gbakwunyere nhazi ederede. Ntuzi aka na-enweghị nkewa na ụdị koodu koodu ọtụtụ iyi na-eme ka ntụkwasị obi na nhazi ederede. Ịmepụta ọdịyo pụtara ịlele akara ngosi na-akpaghị aka, wee degharịa ha n'ụdị ebili mmiri na codec.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke Synthesis nke AudioGen Text-to-Audio Synthesis
Ederede gaa na ọdịyo na-aga n'ụgwọ nlele dị elu, ihe nkiri na-emekọ ihe ọnụ, yana njikwa ike karịa oge na ntinye ụda. Na-atụ anya ntinye n'ime ngwaọrụ vidiyo nke na-agbakwunye mmetụta ụda dabara adaba na-akpaghị aka, ngwaọrụ nnweta nke na-akọwa ihe nkiri nke ọma, yana igwe egwuregwu na-emepụta ọdịyo gburugburu ka achọrọ. Ijikọta ụdị token ụdị AudioGen na ụzọ mgbasa ozi na ndị na-edekọ ederede siri ike kwesịrị imeziwanye eziokwu, ebe watermarking na ngwaọrụ provenance ga-enyere aka ịmata ọdịiche nke sịntetik na ụda edekọ.
Mmejuputa n'ezie n'ụwa
Ịmepụta Foley na mmetụta ụda maka ihe nkiri na egwuregwu sitere na mkpali ederede
Ịmepụta ọdịdị ụda gburugburu (mmiri ozuzo, okporo ụzọ, oke ọhịa) maka ngwa na ngwaọrụ ntụgharị uche
Prototyping ọdịyo maka ọrụ vidiyo na-enyeghị ụlọ akwụkwọ ikike ikike
Na-ewepụta mmachi omenala yana ụda ngosi akọwara n'asụsụ dị larịị
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AudioGen Text-to-Audio Synthesis quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
DDSP Synthesis ọdịyo dị iche
Ajụjụ a na-ajụkarị
What is AudioGen Text-to-Audio Synthesis?
AudioGen bụ ihe atụ Meta na-atụgharị nkọwa ederede ka ọ bụrụ ụda gburugburu ebe obibi na mmetụta ụda dị adị, dị ka 'nkịta na-agbọ ụja ka nnụnụ na-agbọkwa.' Ọ dị mkpa n'ihi na ọ na-ahapụ ndị okike ka ha wepụta ọdịyo na-abụghị okwu site na asụsụ dị larịị, ike na-efu ogologo oge site na AI na-emepụta ihe.
Kedu ihe AudioGen na-ebute ụzọ?
AudioGen ọkachamara na-abụghị okwu, ọdịyo izugbe dị ka ụda gburugburu ebe obibi na mmetụta emepụtara site na mkpali ederede.
Kedu ihe bụ ọkwa mbụ na pipeline AudioGen?
Codec autoencoder neural na-echikota ọdịyo raw ka ọ bụrụ akara pụrụ iche nke ụdị asụsụ nwere ike ibu amụma.
Kedu ụdị ụdị na-ebu amụma maka akara ọdịyo?
AudioGen na-eji ihe ntụgharị autoregressive nke na-ebu amụma akara ọdịyo otu otu, dabere na ederede.
Gịnị mere ndị odee ji gwakọta ma jikọta ọdịyo n'oge ọzụzụ?
Iji obere vidiyo agwakọtara yana gbakọta ọnụ kwalitere ike AudioGen imepụta ọtụtụ ụda akọwara ọnụ na ngwa ngwa.
Kedu ọba akwụkwọ Meta nke gụnyere AudioGen?
AudioGen bụ akụkụ nke ọba akwụkwọ AudioCraft Meta, nke nwekwara ụdị MusicGen.