Uhlolojikelele
I-EnCodec iyikhodekhi yomsindo we-neural ethembekile engu-Meta ecindezela inkulumo nomculo ngama-bitrate aphansi kakhulu ngekhwalithi ephikisana namafomethi asinda kakhulu. Ibalulekile ngoba isekela amasistimu omsindo akhiqizayo wesimanje kanye nemikhumbi ngendlela yomthombo ovulekile ukuze isetshenziswe yinoma ubani.
I-EnCodec Audio Compression ihlezi ekugelezeni komsebenzi we-audio-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.
I-Deep Dive
Ikhishwe yi-Meta AI ngo-2022, i-EnCodec ilandela ipulani ye-SoundStream yesishumeki, i-residual vector quantizer (RVQ), kanye nesikhiphi esiqeqeshiwe ekupheleni, kodwa yengeza ukucolisiswa okumbalwa. Isebenzisa i-convolutional encoder enamandla okusakaza, i-spectrogram enezilinganiso eziningi kanye nokulahlekelwa kokwakhiwa kabusha kwesizinda sesikhathi, kanye nababandlululi abaphikisanayo ngekhwalithi yombono. Umnikelo ophawulekayo imodeli encane ye-entropy esekelwe ku-Transformer eqhubeka icindezela amakhodi abaliwe ngokungalahleki, icindezela izingcezu ezengeziwe ngaphandle kokulahlekelwa kwekhwalithi. I-EnCodec iphinde yethule isilinganisi esikala ngokuzenzakalelayo ukulahleka okuningi kokuqeqeshwa okuqhudelanayo ukuze bahlale bezinzile. Iphatha umsindo we-monophonic ongu-24 kHz kanye no-48 kHz westereo, isebenza kuwo wonke ama-bitrate afana no-1.5, 3, 6, no-12 kbps, futhi ku-6 kbps ifinyelela kukhwalithi eqhathaniswa ne-MP3 ku-64 kbps. Amathokheni ayo anika amandla Meta's MusicGen kanye ne-AudioGen.
I-Technical Insight
Isishumeki se-EnCodec sehlisa isampula i-waveform ngokuguquguquka okunemigqa ibe ukulandelana okucashile, i-RVQ eyiguqula ibe yizinkomba ze-codebook ezistakiwe. Imodeli yolimi lwe-Transformer engasindi ibikezela amathuba alawa mathokheni futhi iwafake amakhodi e-arithmetic, iphinde ithole ukucindezela okwengeziwe mahhala. Ibhalansi yokuqeqesha inciphisa iminikelo yokukhula kusukela ekwakhiweni kabusha, okubonakalayo, nokulahlekelwa okuphambene ukuze kungabikho ithemu elilodwa elibusayo, okugcina ukuqeqeshwa kwezinhloso eziningi kuzinzile kulo lonke ibanga eligcwele le-bitrate.
I-Mastering EnCodec Audio Compression
I-EnCodec iyikhodekhi yomsindo we-neural ethembekile engu-Meta ecindezela inkulumo nomculo ngama-bitrate aphansi kakhulu ngekhwalithi ephikisana namafomethi asinda kakhulu. Ibalulekile ngoba isekela amasistimu omsindo akhiqizayo wesimanje kanye nemikhumbi ngendlela yomthombo ovulekile ukuze isetshenziswe yinoma ubani. I-EnCodec Audio Compression ihlezi ekugelezeni komsebenzi we-audio-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-EnCodec Audio Compression njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa i-EnCodec Audio Compression aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthunyelwa. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukwenza ithokheni yomsindo we-Meta's MusicGen kanye namajeneretha ombhalo ukuya komsindo we-AudioGen
Icindezela inkulumo engu-24 kHz iye ku-1.5-6 kbps ngokudluliswa okukhawulelwe komkhawulokudonsa
Ifaka ngekhodi umculo we-stereo ongu-48 kHz onekhwalithi eduze ne-MP3 ngama-bitrate aphezulu kakhulu
Isebenza njengekhodekhi yokungena yomthombo ovulekile yocwaningo namapayipi omsindo we-ML kusetshenziswa izindawo zokuhlola ezikhishiwe
Amaphethini Okusebenzisa
Ukucindezelwa komsindo kwe-EnCodec kuyasebenza
Ukwenza ithokheni yomsindo we-Meta's MusicGen kanye namajeneretha ombhalo ukuya komsindo we-AudioGen.
Ukwenza ithokheni yomsindo we-Meta's MusicGen kanye ne-AudioGen text-to-audio generators Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukucindezelwa komsindo kwe-EnCodec kuyasebenza
Icindezela inkulumo engu-24 kHz iye ku-1.5-6 kbps ngokudluliswa okukhawulelwe komkhawulokudonsa.
Ukucindezela inkulumo engu-24 kHz ibe ngu-1.5-6 kbps yokudlulisela okukhawulelwe komkhawulokudonsa Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukucindezelwa komsindo kwe-EnCodec kuyasebenza
Ifaka ngekhodi umculo we-stereo ongu-48 kHz onekhwalithi eduze ne-MP3 ngama-bitrate aphezulu kakhulu.
Ukufaka ikhodi komculo we-stereo ongu-48 kHz onekhwalithi eduze ne-MP3 ngama-bitrate aphezulu kakhulu Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukucindezelwa komsindo kwe-EnCodec kuyasebenza
Isebenza njengekhodekhi yokungena yomthombo ovulekile yocwaningo namapayipi omsindo we-ML kusetshenziswa izindawo zokuhlola ezikhishiwe.
Isebenza njengekhodekhi yokungena yomthombo ovulekile yocwaningo namapayipi e-ML alalelwayo kusetshenziswa izindawo zokuhlola ezikhishiwe Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.