Buyela kuMtapowolwazi
UMHLAHLANDLELA WE-AI womsindo

I-AudioGen Text-to-Audio Synthesis

I-AudioGen iyimodeli Meta eshintsha izincazelo zombhalo zibe imisindo engokoqobo yemvelo nemisindo, njengokuthi 'inja ekhonkotha kuyilapho izinyoni zitshiyoza.

Uhlolojikelele

I-AudioGen iyimodeli Meta eshintsha izincazelo zombhalo zibe imisindo engokoqobo yemvelo nemisindo, njengokuthi 'inja ekhonkotha kuyilapho izinyoni zitshiyoza.' Ibalulekile ngoba ivumela abadali ukuthi bakhiqize umsindo ongakhulumi ngolimi olulula, ikhono okudala lingekho ku-AI yokukhiqiza.

I-AudioGen Text-to-Audio Synthesis ihlala ekuhambeni komsebenzi we-audio-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.

I-Deep Dive

I-AudioGen, ekhishwe yi-Meta AI ngo-2022, iyimodeli yolimi engalawuleki ekhiqiza umsindo ovamile (imisindo, izigcawu ezizungezile, imisindo yezilwane kanye nento) ngokuqondile ngokwaziswa kombhalo. Ngokungafani nezinhlelo zombhalo-kuya-enkulumweni, iqondise umhlaba ongcolile womsindo wansuku zonke. Iqala ngokuminyanisa umsindo ongahluziwe uwenze amathokheni alandelanayo kusetshenziswa i-neural codec (i-autoencoder yesitayela se-EnCodec enobuningi be-vector eyinsalela). Imodeli yolimi lwe-Transformer ibe ifunda ukubikezela lawa mathokheni omsindo abekwe encazelweni yombhalo efakwe ikhodi yesishumeki sombhalo esihlukile. Ukuze kuthuthukiswe ukuqonda kokuqamba, ababhali baxube futhi bahlanganisa amasampuli omsindo ngesikhathi sokuqeqeshwa ukuze imodeli ifunde izinhlanganisela njengemisindo egqagqene. I-AudioGen kamuva yaba yingxenye yelabhulali ye-Meta ye-AudioCraft eduze kwemodeli yomculo ye-MusicGen.

I-Technical Insight

I-AudioGen inezigaba ezimbili. Okokuqala, i-autoencoder ifunda ukwenza imephu ye-waveforms kumfudlana ohlangene wamathokheni ahlukene nangemuva. Okwesibili, i-Transformer iqeqeshwa ngenjongo yokufanisa ulimi ukuze ibikezele ithokheni yomsindo elandelayo enikezwe amathokheni andulele kanye nesimo sombhalo. Isiqondiso samahhala se-Classifier kanye nemodeli ye-codebook yokusakaza okuningi ithuthukisa ukwethembeka nokuqondanisa kombhalo. Ukukhiqiza umsindo kusho ukuthatha amathokheni amasampula ngokuzenzakalelayo, bese uwakhipha amakhodi awabuyisele kufomethi yegagasi ngekhodekhi.

I-Mastering AudioGen Text-to-Audio Synthesis

I-AudioGen iyimodeli Meta eshintsha izincazelo zombhalo zibe imisindo engokoqobo yemvelo nemisindo, njengokuthi 'inja ekhonkotha kuyilapho izinyoni zitshiyoza.' Ibalulekile ngoba ivumela abadali ukuthi bakhiqize umsindo ongakhulumi ngolimi olulula, ikhono okudala lingekho ku-AI yokukhiqiza. I-AudioGen Text-to-Audio Synthesis ihlala ekuhambeni komsebenzi we-audio-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-AudioGen Text-to-Audio Synthesis njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa i-AudioGen Text-to-Audio Synthesis aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthumela. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Le-AudioGen Text-to-Audio Synthesis

Umbhalo ukuya kumsindo uphokophele kuzilinganiso eziphakeme zesampula, izigcawu ezihambisanayo ezinde, nokulawula okuqinile kusikhathi nokubekwa kwendawo kwemisindo. Lindela ukuhlanganiswa kumathuluzi evidiyo anezela ngokuzenzakalela imiphumela yomsindo efanayo, amathuluzi okufinyelela achaza izigcawu ngokuzwakalayo, nezinjini zegeyimu ezihlanganisa umsindo we-ambient uma kudingeka. Ukuhlanganisa amamodeli amathokheni esitayela se-AudioGen nezindlela zokusabalalisa kanye nezifaki khodi zombhalo eziqinile kufanele kuthuthukise amaqiniso, kuyilapho amathuluzi e-watermarking kanye nesiqalo azosiza ukuhlukanisa okokwenziwa nomsindo orekhodiwe.

Ukuqaliswa Komhlaba Wangempela

Ikhiqiza i-Foley nemisindo yamafilimu nemidlalo kusuka ekwazisweni kombhalo

Ukudala imisindo ye-ambient (imvula, ithrafikhi, amahlathi) yezinhlelo zokusebenza namathuluzi okuzindla

I-Prototyping yomsindo wamaphrojekthi wevidiyo ngaphandle kwelayisense yemitapo yolwazi yesitoko

Ukukhiqiza isixwayiso sangokwezifiso nemisindo yezaziso echazwe ngolimi olulula

Amaphethini Okusebenzisa

I-AudioGen Text-to-Audio Synthesis iyasebenza

Ikhiqiza i-Foley nemisindo yamafilimu nemidlalo kusuka ekwazisweni kombhalo.

Ukukhiqiza i-Foley nemisindo yamafilimu nemidlalo ngemiyalo yombhalo Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-AudioGen Text-to-Audio Synthesis iyasebenza

Ukudala imisindo ye-ambient (imvula, ithrafikhi, amahlathi) yezinhlelo zokusebenza namathuluzi okuzindla.

Ukudala imisindo ye-ambient (imvula, ithrafikhi, amahlathi) yezinhlelo zokusebenza namathuluzi okuzindla Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-AudioGen Text-to-Audio Synthesis iyasebenza

I-Prototyping yomsindo wamaphrojekthi wevidiyo ngaphandle kwelayisense yemitapo yolwazi yesitoko.

Umsindo we-Prototyping wamaphrojekthi wevidiyo ngaphandle kokunikeza ilayisense yesitoko Amathimba ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-AudioGen Text-to-Audio Synthesis iyasebenza

Ukukhiqiza isixwayiso sangokwezifiso nemisindo yezaziso echazwe ngolimi olulula.

Ukukhiqiza isixwayiso esingokwezifiso nemisindo yezaziso echazwe ngolimi olulula Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

!

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

!

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole

Izwi AI

Funda ukuthi amasistimu enkulumo abona futhi akhiqize kanjani ulimi.

Funda Umhlahlandlela

Umculo we-AI

Qonda amathuluzi esimanjemanje esizukulwane somculo kanye nemikhawulo.

Funda Umhlahlandlela