What is HumanEval? Definition | AI Understanding

Maanaam

Benn référence ci jafe-jafe prograam Python yi ñuy jëfandikoo ngir natt njubte gi ci defar kode jaaraleko ci test unitaire.

Term yu ci méngoo

Test buñ yamale wala ensemble done yuñ jëfandikoo ngir natt ak méngale liggéeyu model bi.

Referansu jafe-jafe baat ci math ci daara yu mag yi ñuy jëfandikoo ngir jàngat xalaat jéego ci jéego ci misaali làkk yi.

Done yuñ tëye ngir natt kalite model bi ginaaw tàggat bi.

Test-Time xayma

Yokkateg xayma yuñ jëfandikoo ci defar tontu ngir gëna baaxal kalite bi wala xalaat bi.

Kod-evaluation metric buy natt chance yi benn ci k échantillon yiñ defar mën na jàll ci test yi.

Politik yi, seeni sàrt, ak jumtukaayi saytu yiy tegtal ni ñuy jëmmalee ak jëfandikoo IA ci askan wi.

Xoolal itam

MMLU Factuality LLM-as-Judge Citations Bi-Encoder Watermarking Cross-Encoder Mid-training

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda