AudioGen Inyandiko-Kuri-Ijwi
AudioGen nicyitegererezo cya Meta ihindura ibisobanuro byanditse mumajwi nyayo yibidukikije hamwe ningaruka zamajwi, nk '' imbwa itontoma mugihe inyoni zivuga. ' Nibyingenzi kuko ireka abayiremye bakabyara amajwi atavuga bivuye mururimi rworoshye, ubushobozi bumaze igihe bubuze muri AI ibyara.
Kwibira cyane
AudioGen, yasohowe na Meta AI mu 2022, nicyitegererezo cyururimi rwigenga rutanga amajwi rusange (ingaruka zijwi, ibidukikije, amajwi yinyamaswa nibintu) biturutse kumyandiko. Bitandukanye na sisitemu-y-sisitemu, yibanda ku isi irimo akajagari k'amajwi ya buri munsi. Irabanza ikanda amajwi mbisi muburyo bukurikirana ibimenyetso byihariye ikoresheje codec ya neural (EnCodec-yuburyo bwa autoencoder hamwe na vector isigaye). Ururimi rwimikorere ya Transformer noneho yiga guhanura ibi bimenyetso byamajwi byateganijwe kubisobanuro byanditse byashizweho na kodegisi yihariye. Kugirango tunonosore ibihimbano, abanditsi bavanze kandi bahuza amajwi yintangarugero mugihe cyamahugurwa kugirango icyitegererezo gishobore kwiga guhuza nkamajwi arenga. AudioGen yaje kuba igice cya __AIU_PROTECTED_13 __ 'isomero rya AudioCraft isomero rya muzika ya MusicGen.
Ubushishozi
AudioGen ifite ibyiciro bibiri. Ubwa mbere, autoencoder yamajwi yiga gushushanya ikarita yerekana imiterere kumurongo wuzuye wibimenyetso bya discret na inyuma. Icya kabiri, Transformer yatojwe afite intego yo kwerekana imvugo yo guhanura icyerekezo gikurikira amajwi yatanzwe mbere yikimenyetso wongeyeho inyandiko. Ibyiciro bidafite ubuyobozi nubuyobozi bwa codebook-moderi yerekana uburyo bwo kwizerwa no guhuza inyandiko. Gukora amajwi bisobanura gutoranya ibimenyetso byikora, hanyuma ukabisubiza inyuma kumurongo hamwe na codec.
Ingaruka z'Ingamba
Kugera no kugera
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Igiciro na bije
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Umuvuduko n'igipimo
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Kazoza ka AudioGen Umwandiko-Kuri-Ijwi
Umwandiko-ku-majwi urimo werekeza ku bipimo by'icyitegererezo kiri hejuru, birebire birebire, hamwe no kugenzura igihe no gushyira amajwi ahantu. Tegereza kwinjiza mubikoresho bya videwo bihita byongeramo amajwi ahuye, ibikoresho byifashishwa bisobanura amashusho byumvikana, hamwe na moteri yimikino ihuza amajwi ibidukikije kubisabwa. Guhuza AudioGen-yuburyo bwa token moderi hamwe nuburyo bwo gukwirakwiza hamwe na kodegisi zikomeye zigomba kunoza realism, mugihe ibimenyetso byamazi nibikoresho byerekana bizafasha gutandukanya synthique nijwi ryanditse.
Gushyira mu bikorwa Isi
Kubyara Foley ningaruka zamajwi ya firime nimikino bivuye kumyandiko
Gukora amajwi y'ibidukikije (imvura, umuhanda, amashyamba) kuri porogaramu n'ibikoresho byo gutekereza
Gukoresha amajwi yimishinga ya videwo utabiherewe uburenganzira namasomero yimigabane
Gutanga amajwi yihariye yo kumenyesha no kumenyesha byasobanuwe mururimi rworoshye
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AudioGen Text-to-Audio Synthesis quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
DDSP Itandukanyirizo ryamajwi
Ibibazo bikunze kubazwa
What is AudioGen Text-to-Audio Synthesis?
AudioGen nicyitegererezo cya Meta ihindura ibisobanuro byanditse mumajwi nyayo yibidukikije hamwe ningaruka zamajwi, nk '' imbwa itontoma mugihe inyoni zivuga. ' Nibyingenzi kuko ireka abayiremye bakabyara amajwi atavuga bivuye mururimi rworoshye, ubushobozi bumaze igihe bubuze muri AI ibyara.
Ni iki AudioGen itanga mbere?
AudioGen kabuhariwe mu kutavuga, amajwi rusange nk'amajwi y'ibidukikije n'ingaruka ziva mu nyandiko.
Ni ikihe cyiciro cya mbere mu miyoboro ya AudioGen?
Node ya codec autoencoder ikanda amajwi mbisi mubimenyetso byihariye urugero rwururimi rushobora guhanura.
Ni ubuhe bwoko bw'icyitegererezo buhanura ibimenyetso by'amajwi?
AudioGen ikoresha Transformer ya autoregressive ihanura ibimenyetso byamajwi umwe umwe, bisabwa kumyandiko.
Kuki abanditsi bavanze kandi bagahuza amajwi mugihe cy'amahugurwa?
Gutezimbere hamwe na clips ivanze kandi ihujwe byateje imbere AudioGen ubushobozi bwo guhimba amajwi menshi yasobanuwe hamwe mukanya.
Nibihe binini Meta isomero ririmo AudioGen?
AudioGen iri mubice bya __AIU_PROTECTED_13 __ 'isomero rya AudioCraft, ririmo na Moderi ya MusicGen.