MusicGen
MusicGen mooy xeetu IA bu __AIU_PROTECTED_13_ biy defar music ci tegtal bind, ak melodi boo bëgg wala nga yebbi ko.
Résumé
It matters because it puts high-quality, controllable music creation into a single, openly released model that hobbyists and researchers can actually run.
Plongeur bu xóot
Meta AI moo ko genne ci 2023 ci biir projet AudioCraft, MusicGen dafay soppi ay laaj yu melni 'piyeesu synth-pop bu 80s ak bass buy dawal' ci ay clip yu 12 sikon (ñu mëna yokk). MusicGen wuute na ak sistem yu bari etap yi, ndax dafay jëfandikoo benn xeetu làkk Transformer buy wax luy waaja am ci token audio yi codec neuronal EnCodec bi defar. Li muy jàppale ci xel mi mooy motif interleaving token (ñu koy woowe interleaving delay) biy may benn model mu mëna jëfandikoo EnCodec ci anam wu jaar yoon ay token yu bari yu paralel, moytu cascade model yu wuute yuñ njëkka soxla. MusicGen mën nañu ko doxal ci ñaari anam benn yoon: ci tegtal ci mbind ak ci melodi buy royuwaay, suko defee nga mëna laaj 'versioŋ jazz' ci way wi ngay hum. Meta genne na kode bi ak poid yi ci lu leer, taxna ñu bari ñu am jumtukaayi askan wi ak ay jàngat.
Gis-gis xarala
MusicGen dafay wane audio ni ay token yu wuute yu bawoo ci codec EnCodec, bu nekk ci ñoom dafay jàpp ay detay yu wuute. Duñu modele ay dex ak ay model yu wuute, MusicGen daf leen di boole ak ay retard yuñ kontre suko defee benn Transformer autorégresif di leen wax luy am ci benn yoon. Kondisioneeru bind mingi joge ci encodeur text T5, waaye kondisioneeru melodi bi dafay jëfandikoo chromagram (profil pitch-class audio bi) suko defee model bi topp melodi bi te du kopie enregistrement bi ci dëgg.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu MusicGen
MusicGen's open release dafa taxawal yoon wi ñi ko wara topp di jéema daan ak genn gu gëna gudd, gëna dëggu, ak génnug stéréo, boole ci gëna mëna doxal structure bi, jumtukaay yi, ak wàllu way yi. Xaarandil lëkkaloo bu gëna dëgër ci losisel yiy defar music, defar ay weccoo xalaat ci jamono dëgg, ak jumtukaay yu gëna baax ngir soppali wala yokk piste yu fi nekk. Ni beppu music generatif, defay ñaw laaj yi ci wallu taggat-done copyright, ndàmpaay artist yi, ak ni ñuy etikete way yu IA defar ci benn marse bu fees dell.
Doxal ci àdduna dëgg
Defar music ci ginaaw bu amul royalty ngir wideo YouTube ci ab bataaxal
Humming melodi ak laaj MusicGen mu defaral ko orkestar bu mat sëkk
Developpeur jeu yi deñuy gaaw def prototyping ci genre yu bari
Gëstukat yi ak bëgg-bëgg yi dañuy doxal poids open-source ngir jàngat text-to-music
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the MusicGen quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Liggéeyukaay buñ forse
Laaj yi ñuy faral di laaj
What is MusicGen?
MusicGen mooy xeetu IA bu __AIU_PROTECTED_13_ biy defar music ci tegtal bind, ak melodi boo bëgg wala nga yebbi ko. Dafa am solo ndax dafay boole sos music bu baax, buñu mëna saytu ci benn xeetu music buñ mëna génne ci ñépp, te hobbyist yi ak gëstukat yi mën ko doxal.
Yan ñaari xeeti dugal ñoo mëna doxal MusicGen benn yoon?
MusicGen dafay nangu ab bind buy laaj, ak melodi, suko defee nga mëna laaj benn xeetu melodi bu nga joxe.
Ban kodek neuronal mooy defar jeton audio yi MusicGen wax luy waaja am?
MusicGen dafay wane ay jeton yu wuute yu codec EnCodec bu __AIU_PROTECTED_13_ defar, mooy dekode jeton yiñ séentuwoon ci audio bi.
Lan mooy yombal architecture bu MusicGen ci anam yu njëkk ya?
Suñu boole ay token paralel yu EnCodec ak ay retard yuñ kontre, benn Transformateur autorégressif mën na leen modele ci benn yoon, moytu model yu bari.
naka la MusicGen di toppee melodi biñ jox te du kopie enregistrement bi?
Chromagram dafay wane xeetu ton yi am ci diir bi, loolu mooy tax MusicGen mëna méngale armoni ak contour bi ci way wi te du joxe timbre bi njëkk.
Ban projet ak liggéeyukaay moo génne MusicGen?
MusicGen mingi génn ci atum 2023 muy bokk ci projet AudioCraft bu AI, ak kode bu ubbeeku ak poid model.