Incamake
Riffusion ni hack yubwenge itanga umuziki ufata amajwi nkifoto: ihuza neza icyitegererezo cyerekana ishusho ya Stable Diffusion kugirango ishushanye amashusho, hanyuma ihindure ayo mashusho mumajwi. Nibyingenzi kuko yerekana igikoresho cyubatswe muburyo bumwe (amashusho) gishobora kubyara ikindi (umuziki) hafi yububiko bushya.
Riffusion Spectrogram Diffusion yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.
Kwibira cyane
Riffusion, yasohowe mu mpera za 2022 na Seth Forsgren na Hayk Martiros, yatangiye nk'umushinga wo kwishimisha. Amayeri yibanze: spekrogramu ni 2D ishusho aho umurongo utambitse ni igihe, umurongo uhagaritse ni inshuro, naho pigiseli irasa ni ijwi ryinshi. Kubera ko Diffusion Stable isanzwe itanga amashusho uhereye kumyandiko isaba, abayiremye bayitunganije neza kubihumbi n'ibihumbi byombi byerekanwe na ecran ya progaramu. Bimenyeshe hamwe na 'funky jazz bass' kandi byerekana urusaku rudasanzwe muri ecran ya majwi. Kugirango ukore amajwi acuranga, Riffusion ikoresha spekrogramu ikoresheje algorithm ya Griffin-Lim yubaka amakuru yabuze. Kuberako ikwirakwizwa rishobora guhuza neza hagati yibisobanuro, Riffusion irashobora kandi guhinduranya uburyo bumwe mubindi hejuru ya clip ikomeza, ikazunguruka.
Ubushishozi
Riffusion yongeye gukoresha umuyoboro wogukwirakwiza udahindutse: U-Net ikuraho byimazeyo urusaku rwa Gaussiya kumashusho yihishe iteganijwe kumyandiko ya CLIP. Igikorwa cyonyine cyihariye ni icyerekezo cyerekana (mel-scale, log power) hamwe na Griffin-Lim icyiciro cyo kwiyubaka gihindura ubunini bwahanuwe busubira inyuma. Icyiciro cyajugunywe mugihe cya kodegisi, bityo igereranya rya Griffin-Lim nisoko nyamukuru yibintu biranga 'amazi'.
Kumenya Riffusion Spectrogram Diffusion
Riffusion ni hack yubwenge itanga umuziki ufata amajwi nkifoto: ihuza neza icyitegererezo cyerekana ishusho ya Stable Diffusion kugirango ishushanye amashusho, hanyuma ihindure ayo mashusho mumajwi. Nibyingenzi kuko yerekana igikoresho cyubatswe muburyo bumwe (amashusho) gishobora kubyara ikindi (umuziki) hafi yububiko bushya. Riffusion Spectrogram Diffusion yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata Riffusion Spectrogram Diffusion nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Riffusion Spectrogram Diffusion ifata ubuziranenge, ubukererwe, hamwe no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi Ijwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Gukora ibice bigufi byerekana inzira yimikino ya indie uhereye kumyandiko yihuta nka 'tense synthwave chase'
Morphing neza hagati yuburyo bubiri bwumuziki, kuvanga 'inzu yubushyuhe' muri 'lo-fi hip hop' hejuru ya clip imwe
Gukora ibitanda byumuziki udafite ubwami bwibitanda bya videwo na podcaste utishyuye
Prototyping melodic cyangwa rhythmic ibitekerezo umucuranzi noneho yongera kwandika neza mubikorwa byamajwi ya digitale
Uburyo bwo Gushyira mu bikorwa
Riffusion Spectrogram Diffusion mubikorwa
Gukora ibice bigufi byerekana inzira yimikino ya indie uhereye kumyandiko yihuta nka 'tense synthwave chase'.
Gukora ibice bigufi byerekana imikino ya videwo yo mu Buhinde uhereye ku nyandiko yanditse nka 'tense synthwave chase' Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Riffusion Spectrogram Diffusion mubikorwa
Morphing neza hagati yuburyo bubiri bwumuziki, kuvanga 'inzu yubushyuhe' muri 'lo-fi hip hop' hejuru ya clip imwe.
Morphing neza hagati yuburyo bubiri bwumuziki, kuvanga 'inzu yo mu turere dushyuha' muri 'lo-fi hip hop' hejuru ya clip imwe Amakipe akunze kubona umusaruro mwiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Riffusion Spectrogram Diffusion mubikorwa
Gukora ibitanda byumuziki udafite ubwami bwibitanda bya videwo ya YouTube na podcasts nta mafaranga yimpushya.
Gukora ibitanda byumuziki udafite ubwami bwa videwo na podcaste ya YouTube nta mafaranga yabiherewe uruhushya Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Riffusion Spectrogram Diffusion mubikorwa
Prototyping melodic cyangwa rhythmic ibitekerezo umucuranzi noneho yongera kwandika neza mubikorwa byamajwi ya digitale.
Gukoresha ibitekerezo bya melodic cyangwa injyana yumucuranzi hanyuma akongera kwandika neza mugikorwa cyamajwi ya digitale Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.