Perplexity n'ibipimo by'ururimi
Perplexity ni amanota ya kera yerekana uburyo 'gutungurwa' icyitegererezo cyururimi ninyandiko nyayo - bivuze ko bihanura amagambo wizeye.
Incamake
It and metrics like BLEU and ROUGE are how researchers actually measure whether a model is getting better.
Kwibira cyane
Ururimi rwicyitegererezo rutanga amahirwe kuri buri jambo rikurikira. Perplexity ihindura ibyo bishoboka mubare umwe ubaza: ugereranije, ni bangahe bahisemo kimwe icyitegererezo cyatandukanijwe kuri buri ntambwe? Niba icyitegererezo cyizeye neza kandi gikosowe, urujijo ni 1; niba ikeka kimwe mumagambo 50.000, urujijo ni 50.000. Hasi ni byiza. Nibibare byerekana impuzandengo yo gutakaza ijambo, bityo ikurikirana imyitozo itaziguye. Ariko urujijo rupima gusa ijambo rikurikira-guhanura, ntabwo niba umusaruro ari ingirakamaro, ukuri, cyangwa wanditse neza. Niyo mpamvu imirimo yibisekuru yongeramo ibipimo nka BLEU (n-garama ihinduranya kugirango ihindurwe) na ROUGE (guhuzagurika mu ncamake), n'impamvu ibibi bigezweho bigenda byishingikiriza ku manota yabantu n'ibipimo ngenderwaho.
Ubushishozi
. Nubusanzwe ni verisiyo yahinduwe yo gutakaza cross-entropy, gusa bigaragazwa nkibintu bifatika byamashami aho kuba bits cyangwa nats. Kuberako biterwa nurugero rwukuri rwamagambo hamwe na tokenizer, indangagaciro zo kugereranywa ziragereranywa gusa hagati yicyitegererezo gisangiye icyerekezo kimwe - kugereranya ijambo-urwego rwicyitegererezo na sub-jambo ryerekana bitaziguye ntacyo bivuze.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza ha Perplexity n'ibipimo by'ururimi
. Nkurugero rwuzuye, isuzuma rihinduka mubipimo byimirimo nka MMLU, urutonde rwabantu bakunda, hamwe na LLM-nkumucamanza utanga amanota yo gufasha no gukosorwa. Witege ko urujijo ruzakomeza kuba abahanga mu bumenyi bwa metero bareba mugihe cyo kwitegura, mugihe abantu bavuga ko icyitegererezo ari 'cyiza' gishingiye ku bipimo ngenderwaho no gusuzuma abantu ku mutwe bifata ibitekerezo no kuvugisha ukuri ntibishobora.
Gushyira mu bikorwa Isi
Gukurikirana kwemeza urujijo mugihe cyo kwitegura kwemeza icyitegererezo kiracyiga no kumenya igihe gitangiye gukwira
Koresha amanota ya BLEU kugirango ugereranye sisitemu nshya yo guhindura imashini hamwe nubusobanuro bwabantu
Raporo ROUGE-L ihuzagurika kugirango igenzure amakuru-incamake yerekana kurwanya zahabu-isanzwe
Ugereranije ibyitegererezo bibiri byerekana kuri corpus imwe kugirango uhitemo umwe uhanura inyandiko wizeye
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Perplexity and Language Metrics quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwerekana Ururimi
Ibibazo bikunze kubazwa
What is Perplexity and Language Metrics?
Perplexity ni amanota ya kera yerekana uburyo 'gutungurwa' icyitegererezo cyururimi ninyandiko nyayo - bivuze ko bihanura amagambo wizeye. Nibipimo nka BLEU na ROUGE nuburyo abashakashatsi bapima niba icyitegererezo kigenda neza.
Niki amanota MASO yo gutesha umutwe yerekana kubyerekeranye nururimi?
Perplexity ipima uburyo icyitegererezo gitangaje ninyandiko nyayo; hasi yo gutangara bivuze ko itanga amahirwe menshi kumagambo akurikira, bityo irahanura cyane.
Perplexity ikomoka mu mibare ikomoka ku bwinshi bw'amahugurwa?
.
Umunyamideli atanga amahirwe amwe mumagambo 10,000-yamagambo atize. Ni ubuhe buryo butangaje?
Perplexity numubare wingenzi wo guhitamo kimwe. Kuringaniza neza gukeka amagambo arenga 10,000 bitanga urujijo rwa 10,000.
Ni ukubera iki amanota yo gutangara ava muburyo bubiri butandukanye ashobora kuyobya kugereranya muburyo butaziguye?
Kuberako urujijo rubarwa kuri buri kimenyetso, ijambo-urwego hamwe na sub-jambo moderi bigabanyijemo inyandiko zitandukanye, bigatuma indangagaciro zabo zibabaje zitagereranywa.
Nibihe bipimo bifitanye isano cyane no gusuzuma imashini isobanurwa na n-garama hamwe na reference?
BLEU ipima guhuza ijambo n-garama hagati yubusobanuro bwa sisitemu hamwe n’umuntu, kandi ni urwego rurerure rwo gusuzuma ibisobanuro.