UMHLAHLANDLELA WE-AI womsindo

Isilinganiso se-CREPE Pitch

I-CREPE imodeli yokufunda ejulile elinganisela imvamisa eyisisekelo (iphimbo) yesiginali yomsindo we-monophonic ngokuqondile kufomethi yayo yegagasi eluhlaza.

2 amaminithi ukufundaIgcine ukubuyekezwa

Uhlolojikelele

It set a new accuracy standard for pitch tracking, especially on noisy or difficult recordings.

I-Deep Dive

I-CREPE (I-Convolutional Representation for Pitch Estimation), eyethulwe ngo-2018 nguKim, Salamon, Li, no-Bello, ibikezela ukuphakama komsindo wenothi elilodwa (monophonic) njengezwi eliculwayo noma insimbi eyedwa. Ngokungafani nama-algorithms akudala afana ne-YIN noma i-pYIN ancike ekuhlanganiseni okuzenzakalelayo kwesiginali, i-CREPE iyinethiwekhi ejulile ye-neural eqeqeshwe ngokuqondile kumafreyimu omsindo wesizinda sesikhathi. Ifaka uhlaka lokulinganisa kwephimbo njengenkinga yokuhlukanisa: ikhipha amathuba okusabalalisa phezu kwemigqomo yokuphakama engu-360 ehlanganisa cishe ama-octave ayisithupha, ngayinye ihlukana ngamasenti angu-20. Umgqomo onokusebenza okuphezulu kakhulu, ocwengisiswe ngesilinganiso sendawo enesisindo, unikeza imvamisa elinganiselwe kanye nesikolo sokuzethemba. I-CREPE ibonakale iqine ngokuphawulekayo kunezindlela zokucubungula isignali, ikakhulukazi ngaphansi komsindo, futhi manje isiyingxenye evamile kumapayipi amaningi okuhlaziya umculo nenkulumo.

I-Technical Insight

I-CREPE ithatha uhlaka lomsindo oluyisampula engu-1024 futhi iludlulise ngezandlalelo eziyisitaki eziyisitaki eziyisi-6, ezigcina ngesendlalelo sokuphumayo samayunithi angama-360 ngokusebenza kwe-sigmoid. Iyunithi ngayinye ihambisana nomgqomo wokulinganisa ohlukaniswe ngamasenti angu-20 phakathi kwama-octave ayisithupha. Inethiwekhi iqeqeshwe nge-binnary cross-entropy ngokumelene nethagethi efiphalisiwe ye-Gaussian egxile kuphimbo langempela. Uma kucatshangelwa, imvamisa ebikezelwe isilinganiso sendawo esinesisindo sokwenziwa kusebenze eduze komgqomo omkhulu, futhi ukuphakama okuphezulu kusebenza njengevelu yokuzethemba.

I-Strategic Impact

Finyelela futhi ufinyelele

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Izindleko kanye nesabelomali

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Isivinini nesikali

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Ikusasa le-CREPE Pitch Estimation

Ukulinganisa kwe-pitch kuya kumamodeli ahlangene aphatha i-polyphony (amanothi amaningi ngesikhathi esisodwa), ukubambezeleka okuphansi kokushuna kwesikhathi sangempela nokuvumelana okuzenzakalelayo, namanethiwekhi amancane ancibilikisiwe asebenza kumafoni nakumadivayisi ashumekiwe. Imiphumela yokuzethemba ye-CREPE iya ngokuya ifakwa emisebenzini engezansi njengokuloba okuzenzakalelayo, ukulungisa izwi, nokuhlaziywa kokusebenza okuvezayo. Izindlela zokuzigada kanye nemisebenzi eminingi ezifunda ukuphakama eduze kwe-timbre nokuphimisa kungenzeka zinwebe ukunemba kwesitayela se-CREPE kudlule umsindo ohlanzekile we-monophonic.

Ukuqaliswa Komhlaba Wangempela

Ukulandelela iphimbo lomculi ukuze uthole impendulo yokushuna ngesikhathi sangempela ezinhlelweni zokusebenza zokuqeqesha iphimbo

Ukushayela ukushuna okuzenzakalelayo kanye namathuluzi okulungisa iphimbo anamajika anembayo ayisisekelo

Ukuloba imiculo yezinsimbi eziyedwa ku-MIDI noma kumculo weshidi

Ukuhlaziya iphimbo kanye ne-vibrato emfundweni yomculo nokucwaninga kokusebenza

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Qhubeka Uhlole

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the CREPE Pitch Estimation quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Qala imibuzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Umhlahlandlela olandelayo

I-FastPitch Pitch-Controllable TTS

Imibuzo evame ukubuzwa

What is CREPE Pitch Estimation?

I-CREPE imodeli yokufunda ejulile elinganisela imvamisa eyisisekelo (iphimbo) yesiginali yomsindo we-monophonic ngokuqondile kufomethi yayo yegagasi eluhlaza. Ibeke indinganiso entsha yokunemba yokulandelela iphimbo, ikakhulukazi ekurekhodweni okunomsindo noma okunzima.

I-CREPE ilinganisela ini kusiginali yomsindo?

I-CREPE ibikezela imvamisa eyisisekelo, okungukuthi ukuphakama okucatshangwayo, komsindo we-monophonic.

I-CREPE yakhelwe ngokuyinhloko ukuthi yiluphi uhlobo lomsindo?

I-CREPE ilinganisela ukuphakama kwamasignali e-monophonic njengezwi elilodwa noma insimbi eyedwa.

I-CREPE iwuhlaka kanjani umsebenzi wokulinganisa iphimbo ngaphakathi?

I-CREPE ikhipha amathuba okusabalalisa imigqomo engama-360, iphatha ukulinganisa njengokuhlukanisa.

I-CREPE ithatha ini njengokufaka kwayo okuqondile?

Ngokungafani nezindlela ezisekelwe ku-spectrogram, i-CREPE isebenza kumafreyimu we-waveform eluhlaza ngokusebenzisa izendlalelo ze-convolutional.

Iqhelelene kangakanani imigqomo ye-CREPE's pitch bin?

I-CREPE isebenzisa imigqomo engu-360 ehlukaniswe ngamasenti angu-20, inikeze ukulungiswa kwe-sub-semitone kuwo wonke ama-octave ayisithupha.