What is HumanEval? Definition | AI Understanding

Incazelo

Ibhentshimakhi yezinkinga zohlelo lwePython esetshenziselwa ukukala ukulunga kokukhiqiza ikhodi ngokuhlolwa kweyunithi.

Imigomo ehlobene

Ukuhlolwa okujwayelekile noma isethi yedatha esetshenziselwa ukukala nokuqhathanisa ukusebenza kwemodeli.

Ibhentshimakhi yezinkinga zamagama ezibalo zebanga lesikole ezisetshenziselwa ukuhlola ukucabanga kwesinyathelo nesinyathelo kumamodeli olimi.

Isethi Yokuhlola

Idathasethi ebanjiwe esetshenziselwa ukukala ikhwalithi yemodeli ngemva kokuqeqeshwa.

Ikhompyutha Yesikhathi Sokuhlola

Izibalo ezengeziwe zokucatshangelwa ezisetshenziswa ngesikhathi sokwenziwa kwezimpendulo ukuze kuthuthukiswe ikhwalithi noma ukucabanga.

Imethrikhi yokuhlola ikhodi ekala ithuba lokuthi okungenani isampuli eyodwa kwamasampula akhiqizwe ngu-k aphumelele ukuhlolwa.

Izinqubomgomo, amazinga, kanye nezindlela zokwengamela eziqondisa ukuthi i-AI ithuthukiswa futhi isetshenziswe kanjani emphakathini.

Bhekafuthi

MMLU Factuality LLM-as-Judge Citations Bi-Encoder Watermarking Cross-Encoder Mid-training

Phequlula Uhla lwamagama olugcwele lwe-AI Hlola yonke imihlahlandlela ye-AI yamahhala