Audio AI JAGORA

Tagging na kiɗa tare da masu canzawa

Alamar waƙar tana amfani da ƙirar mai canzawa don sauraron waƙa da tsinkaya alamomin siffa kamar nau'in, yanayi, kayan kida, da ɗan lokaci.

2 min karatuAn sabunta ta ƙarshe

Dubawa

It powers search, recommendation, and auto-organization across huge music catalogs.

Zurfafa nutsewa

Kiɗa ta atomatik matsala matsala ce mai yawa: waƙa ɗaya na iya zama 'dutse,' 'mai kuzari,' 'guitar' da 'kayan aiki' gaba ɗaya. Masu canza canji suna magance shi ta hanyar juya sauti zuwa spectrogram (hoton mitar lokaci) da ciyar da facin ta ta hanyar kula da kai, kamar yadda mai canza hangen nesa ke kula da facin hoto. Samfura irin su Audio Spectrogram Transformer (AST) da MERT suna koyon tsarin dogon zango a cikin waƙa gaba ɗaya, suna ɗaukar yadda ƙungiyar mawaƙa ke da alaƙa da aya tsakanin mintuna. Da yawa an riga an horar da kai akan miliyoyin shirye-shiryen bidiyo marasa laka, sannan an daidaita su akan matattun bayanai kamar MagnaTagATune ko Dataset na Waƙar Miliyan. Saboda alamun ba su keɓanta juna ba, Layer na ƙarshe yana amfani da abubuwan sigmoid da aka zira a kan maƙasudai kamar matsakaicin daidaito da ROC-AUC.

Fahimtar Fasaha

Ana jujjuya sautin mai daɗaɗɗen zuwa spectrogram na log-Mel, an raba shi zuwa faci masu daidaitawa, kuma an haɗa shi da layi tare da rufaffiyar matsayi. Hankalin kai yana barin kowane faci ya auna kowane facin, don haka abubuwan kida masu nisa suna tasiri kowane alamar. Ba kamar nau'ikan nau'ikan hoto guda ɗaya ba, alamar waƙar tana aiki da sigmoid kowace tag maimakon softmax ɗaya, tunda alamun suna tare. Horowa mai kulawa da kai (na tsinkayar alamun sauti mai rufe fuska) yana ba da wakilci mai ƙarfi kafin daidaitawa akan ƙananan saiti masu lakabi.

Dabarun Tasiri

Shiga ku isa

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.

Kudin da kasafin kuɗi

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.

Gudu da sikelin

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.

Makomar Kiɗa Tagging tare da Transformers

Tagging yana haɗuwa tare da fahimtar yaren yanayi don haka zaku iya bincika 'mafarki lo-fi tare da vinyl crackle don yin karatu' maimakon kafaffen maɓallan nau'ikan. Samfuran rubutu mai jiwuwa mai sabani kamar CLAP suna daidaita kiɗa da kwatance a sarari ɗaya, yana ba da damar alamar-harbin da ba a taɓa gani a horo ba. Yi tsammanin mafi arziƙi, ƙarin tambarin ƙira, mafi kyawun sarrafa nau'ikan fusion, da alamar kan na'urar don keɓantawa. Hakkoki da muhawara game da horarwa kan kasidu masu haƙƙin mallaka za su tsara irin bayanan da waɗannan samfuran za su iya amfani da su.

Aiwatar da Gaskiyar Duniya

Samar da nau'i ta atomatik da alamun yanayi don ayyukan yawo zai iya gina jerin waƙoƙin 'mayar da hankali' ko ' motsa jiki'

Barin dakunan karatu na kiɗa su fito da waƙoƙin 'upbeat acoustic guitar' don masu gyara bidiyo suna neman lasisin aiki tare.

Ƙarfafa injunan shawarwarin da ke samo irin waƙoƙin son rai fiye da abin da masu amfani suka ƙididdige su

Tsara tarin samfurin furodusa ta kayan aiki da aka gano, maɓalli, da ɗan lokaci ta atomatik

Hatsari & Tsare-tsare

Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.

Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.

Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.

Taswirar Hanya

1

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.

2

Gwajin ingantattun masu magana daban-daban da yanayin baya.

3

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.

4

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.

Ci gaba da Bincike

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Music Tagging with Transformers quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Fara tambayoyi

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Tambayoyin da ake yawan yi

What is Music Tagging with Transformers?

Alamar waƙar tana amfani da ƙirar mai canzawa don sauraron waƙa da tsinkaya alamomin siffantawa kamar nau'i, yanayi, kayan kida, da ɗan lokaci. Yana ba da ikon bincike, shawarwari, da tsari ta atomatik a cikin manyan kasidun kiɗa.

Me yasa ake ɗaukar alamar waƙa azaman matsala mai yawan lakabi?

Waƙar na iya zama dutsen, mai kuzari, da kuma sarrafa gita lokaci guda, don haka alamomi da yawa suna shafi waƙa ɗaya.

Wane wakilcin shigarwa ne masu tambarin wuta ke amfani da shi?

Ana juyar da sauti zuwa sikirin mitar lokaci-lokaci, sannan ana faci kuma a ciyar da su ta hanyar kulawa da kai kamar facin hoto.

Me yasa ƙirar kiɗan kiɗa ke amfani da fitowar sigmoid kowace tag maimakon softmax ɗaya?

Softmax yana tilasta yuwuwar haɓakawa zuwa ɗaya (zaɓi ɗaya); sigmoid yana barin kowane tag ya zama gaskiya mai zaman kansa.

Menene aikin horarwa na kulawa da kai don samfuri kamar MERT?

Horowa akan tsinkayar sauti mai rufe fuska akan manyan kamfanoni marasa lakabi yana gina wakilci daga baya an daidaita su akan bayanan da aka yiwa alama.

Wanne saitin bayanai ne akafi amfani dashi don daidaitawa da alamar kida?

MagnaTagaTune da Million Song Dataset su ne madaidaitan ma'auni na kiɗa; MNIST da ImageNet sune saitin hoto.