UMHLAHLANDLELA WE-AI womsindo

I-Riffusion Spectrogram Diffusion

Uhlolojikelele

I-Riffusion Spectrogram Diffusion ihlala ekuhambeni komsebenzi okulalelwayo-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.

I-Deep Dive

I-Riffusion, ekhishwe ngasekupheleni kuka-2022 nguSeth Forsgren noHayk Martiros, yaqala njengephrojekthi yokuzilibazisa. Iqhinga eliwumgogodla: i-spectrogram yisithombe se-2D lapho i-eksisi evundlile kuyisikhathi, i-eksisi eqondile iyimvamisa, nokukhanya kwe-pixel kungumsindo. Njengoba i-Stable Diffusion isivele ikhiqiza izithombe kusuka ekwazisweni kombhalo, abadali bayilungise kahle ezinkulungwaneni zezibonelo zombhalo we-spectrogram obhanqiwe. Itshele 'nge-funky jazz bass' futhi ikhiphe umsindo ongahleliwe ibe i-spectrogram yalowo msindo. Ukuze yenze umsindo odlalekayo, i-Riffusion isebenzisa i-spectrogram nge-algorithm ye-Griffin-Lim eyakha kabusha ulwazi lwesigaba olungekho. Ngenxa yokuthi ukusabalalisa kungahumusheka kahle phakathi kokwaziswa, i-Riffusion ingaphinda iguqule isitayela esisodwa sibe kwesinye phezu kwesiqeshana esiqhubekayo, ivuleke ngaphandle komthungo.

I-Technical Insight

I-Riffusion iphinda isebenzise ipayipi lokusabalalisa elicashile lingashintshiwe: i-U-Net isusa ngokuphindaphindiwe umsindo we-Gaussian esithombeni esicashile esifakwe ekushumekeni kombhalo we-CLIP. Okuwukuphela komsebenzi oqondene nesizinda ukumelela kwe-spectrogram (isikali se-mel, amandla elogi) kanye nokwakhiwa kabusha kwesigaba se-Griffin-Lim esiphendulela i-spectrogram yobukhulu obubikezelwe ibe i-waveform. Isigaba siyalahlwa ngesikhathi sombhalo wekhodi, ngakho ukulinganisa okuphindaphindayo kuka-Griffin-Lim kuwumthombo oyinhloko wesici sezinto zobuciko 'ezinamanzi'.

I-Mastering Riffusion Spectrogram Diffusion

I-Riffusion iwukugebenga okuhlakaniphile okukhiqiza umculo ngokuphatha umsindo njengesithombe: ishuna kahle imodeli yesithombe eStable Diffusion ukuze ipende ama-spectrogram, bese iguqula lezo zithombe zibuyele emsindweni. Kubalulekile ngoba kukhombisa ukuthi ithuluzi elakhelwe imidiya eyodwa (izithombe) lingakhiqiza elinye (umculo) cishe elingenazo izakhiwo ezintsha. I-Riffusion Spectrogram Diffusion ihlala ekuhambeni komsebenzi okulalelwayo-AI okuguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-Riffusion Spectrogram Diffusion njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa i-Riffusion Spectrogram Diffusion aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthunyelwa. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Le-Riffusion Spectrogram Diffusion

I-Riffusion ifakazele ukuthi ibhuloho le-spectrogram-as-image liyasebenza, futhi lowo mbono manje uhlala ngaphakathi kwamasistimu omsindo amakhulu futhi inkampani i-Riffusion yaba. Lindela amathuluzi esikhathi esizayo wokushintsha u-Griffin-Lim olahlekile ufake amavokhoda e-neural afundiwe esigabeni esihlanzekile, kanye nokuhlanganisa ukuhlukaniswa kwe-spectrogram namakhodekhi omsindo acashile. Isifundo esibanzi, sokuthi amamodeli ezithombe angaqondiswa kabusha ezindleleni ezintsha, siyaqhubeka nokuba nomthelela ekutheni abacwaningi baqala kanjani amajeneretha omsindo nevidiyo avela kumgogodla oqeqeshwe kusengaphambili.

Ukuqaliswa Komhlaba Wangempela

Ikhiqiza amathrekhi angemuva amafushane alandelanayo emidlalo yevidiyo ye-indie kusukela kumlayezo wombhalo ofana ne-'tense synthwave chase'

I-Morphing kahle phakathi kwezitayela zomculo ezimbili, isb. ukuhlanganisa 'indlu eshisayo' ibe 'lo-fi hip hop' esiqeshaneni esisodwa

Ukukhiqiza imibhede yomculo we-ambient yamavidiyo e-YouTube nama-podcast ngaphandle kwezindleko zamalayisense

I-Prototyping melodic imibono noma enesigqi umculi bese ayiqopha kabusha kahle endaweni yokusebenza yomsindo wedijithali

Amaphethini Okusebenzisa

I-Riffusion Spectrogram Diffusion in practice

Ikhiqiza amathrekhi angemuva amafushane alandelanayo wamageyimu evidiyo e-indie asuka emyalweni wombhalo ofana ne-'tense synthwave chase'.

Ikhiqiza amathrekhi angemuva amafushane alandelanayo amageyimu evidiyo e-indie asuka emyalweni wombhalo ofana ne-'tense synthwave chase' Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Riffusion Spectrogram Diffusion in practice

I-Morphing kahle phakathi kwezitayela zomculo ezimbili, isb. ukuhlanganisa 'indlu eshisayo' ibe 'lo-fi hip hop' esiqeshaneni esisodwa.

I-Morphing kahle phakathi kwezitayela zomculo ezimbili, isb. ukuhlanganisa 'i-tropical house' ku-'lo-fi hip hop' kusiqeshana esisodwa Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Riffusion Spectrogram Diffusion in practice

Ikhiqiza imibhede yomculo we-ambient yamavidiyo e-YouTube nama-podcast ngaphandle kwezimali zamalayisense.

Ukukhiqiza imibhede yomculo ye-ambient yamavidiyo e-YouTube nama-podcast ngaphandle kwezimali zelayisensi Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka kwabantu yamacala abucayi, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Riffusion Spectrogram Diffusion in practice

I-Prototyping melodic noma imibono enesigqi umculi bese ayiqopha kabusha kahle endaweni yokusebenza yomsindo wedijithali.

I-Prototyping melodic imibono noma enesigqi umculi bese ayiqopha kabusha ngendlela efanele esiteshini sokusebenza somsindo wedijithali Amathimba ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole

Izwi AI

Funda ukuthi amasistimu enkulumo abona futhi akhiqize kanjani ulimi.

Funda Umhlahlandlela

Umculo we-AI

Qonda amathuluzi esimanjemanje esizukulwane somculo kanye nemikhawulo.

Funda Umhlahlandlela