Faafinta Spectrogram Riffusion
Riffusion waa jabsi xariif ah oo soo saara muusig iyada oo u daawaynaysa codka sidii sawir: waxay si fiican u habaynaysaa qaabka sawirka Stable Diffusion si ay u rinjiso spectrograms, ka dibna sawiradaas dib ugu celiso maqal.
Dulmar
It matters because it shows a tool built for one medium (images) can produce another (music) with almost no new architecture.
quusid qoto dheer
Riffusion, oo ay sii daayeen dabayaaqadii 2022 ee Seth Forsgren iyo Hayk Martiros, ayaa u bilaabmay mashruuc hiwaayad ah. Khiyaamada xudunta u ah: spectrogram waa sawir 2D ah halka dhidibka toosan uu yahay wakhti, dhidibka toosan waa inta jeer, iyo dhalaalka pixel waa qaylo. Maaddaama Stable Diffusion ay horeba u soo saartay sawirro kicinta qoraalka ah, abuurayaashu waxay si fiican u habeeyeen kumanaan tusaalayaal qoraal-spectrogram-ka lammaane ah. Ku darso 'funky jazz bass' oo waxay diidaysaa qaylada random ee muuqaalka codkaas. Si loo sameeyo maqal la ciyaari karo, Riffusion waxay ku socodsiisaa spectrogram-ka iyada oo loo marayo Griffin-Lim algorithm kaas oo dib u dhis ku sameeya macluumaadka wejiga maqan. Sababtoo ah faafintu waxay si habsami leh u dhexgali kartaa inta u dhaxaysa dardargelinta, Riffusion waxay sidoo kale u beddeli kartaa qaab kale iyada oo loo marayo clip joogto ah, si aan kala go 'lahayn.
Aragtida Farsamada
Riffusion waxay dib u isticmaashaa dhuumaha faafinta daahsoon oo aan isbeddelin: U-Net waxay si isdaba joog ah uga saartaa dhawaaqa Gaussian sawirka qarsoon ee ku xidhan qoraalka CLIP. Shaqada kaliya ee gaarka ah ee domain-ka ayaa ah matalaadda spectrogram-ka (mel-scale, power log) iyo dib u dhiska wejiga Griffin-Lim kaas oo cabbirka cabbirka ee la saadaaliyay dib ugu noqda qaab mawjad. Marxaladda waa la tuuraa inta lagu guda jiro codaynta, markaa Griffin-Lim qiyaastiisa soo noqnoqota ayaa ah isha ugu weyn ee sifada 'biyaha' artifacts.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka Faafinta Spectrogramka Riffusion
Riffusion waxay caddeeyeen buundada spectrogram-sida-sawirku inay shaqeyso, fikradaas hadda waxay ku nooshahay gudaha nidaamyada maqalka weyn iyo shirkadda Riffusion waxay noqotay. Filo aaladaha mustaqbalka si ay ugu beddelaan Griffin-Lim lumay cod-bixiyeyaal neural ah oo la bartay si loogu wajaho nadiifinta, iyo in la isku daro faafinta spectrogram iyo codecs maqal ah oo qarsoon. Casharka ballaaran, in moodooyinka sawirada loo jiheynayo habab cusub, waxay sii wadaan inay saameyn ku yeeshaan sida cilmi-baarayaashu ay ugu dhejiyaan maqal-dhaliyaha iyo fiidiyoowga laf-dhabarta hore loo tababaray.
Dhaqangelinta Adduunka-dhabta ah
Abuuritaanka raad-raac gaagaaban oo gadaal gadaal ah oo loogu talagalay ciyaaraha fiidyaha ee indie-ga laga bilaabo isla markiiba qoraalka sida 'tse synthwave chase'
Morphing si habsami leh oo u dhexeeya laba qaab muusig, tusaale. isku darka 'guriga kulaylaha' ee 'lo-fi hip hop' oo dhan hal clip
Soo saarista sariiraha muusiga deegaanka ee bilaa royaltyka ah ee fiidyaha YouTube iyo muuqaalada muuqaalada iyada oo aan wax kharash ah laga bixin
Soo koobida fikradaha laxanka ama laxanka taasoo muusikiiste dib ugu duubo si sax ah goobta shaqada maqalka dhijitaalka ah
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Riffusion Spectrogram Diffusion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
DiffWave Diffusion Vocoder
Su'aalaha soo noqnoqda
What is Riffusion Spectrogram Diffusion?
Riffusion waa jabsi xariif ah oo soo saara muusig iyada oo u daawaynaysa codka sidii sawir: waxay si fiican u habaynaysaa qaabka sawirka Stable Diffusion si ay u rinjiso spectrograms, ka dibna sawiradaas dib ugu celiso maqal. Waa arrin sababtoo ah waxay muujinaysaa qalab loo dhisay hal dhexdhexaad ah (sawirrada) ayaa soo saari kara mid kale (muusig) oo aan ku dhawaad ahayn naqshad cusub.
Qaabkee AI ee jira ayuu Riffusion u hagaajiyay si uu u dhaliyo muusig?
Riffusion si fiican loo habeeyey Stable Diffusion, qaab muuqaal faafin ah, si loo soo saaro sawirro spectrogram ah oo markaa loo beddelo maqal.
Muxuu spectrogram-ku u taagan yahay labadiisa faas?
spectrogram-ka dhidibka toosan waa wakhti, dhidibka toosan waa inta jeer, dhalaalkuna waxa uu u taagan yahay qaylo.
Muxuu Riffusion ugu baahan yahay algorithm sida Griffin-Lim?
Sawir-qaaduhu wuxuu kaydiyaa cabbirka laakiin wuxuu tuurayaa marxaladda, markaa Griffin-Lim waxay si qiyaasi ah u qiyaastay wejiga si ay dib ugu dhisto qaab mowjad la ciyaari karo.
Awood noocee ah ayay faafintu siinaysaa Riffusion marka la isku darayo laba dardaaran?
Moodooyinka faafinta waxay isku dhex geli karaan meel bannaan oo daahsoon, taasoo u oggolaanaysa Riffusion inuu si joogto ah uga guuro hal qaab muusiko una wareego mid kale.
Sidee markii hore loo abuuray oo loo sii daayay Riffusion?
Riffusion waxay ku bilaabatay mashruuc hiwaayad ah oo ay sameeyeen Seth Forsgren iyo Hayk Martiros, oo si cad loo sii daayay dabayaaqadii 2022.