Guide-yakabatana mibvunzo · Pakati Nhanho

Kuvaka iyo LLM Eval Dataset Quiz

Miedzo inotsvaga makesi chaiwo, mhinduro dzegoridhe maringe nemarubriki, kuvharika kwekesi, uye kuyera eval seti kuitira kuti misiyano yezvibodzwa zvine musoro.

Nzira dzekutungamira dzinoenderanaKuvaka LLM Eval Datasets
Mubvunzo 1 ye 8

Chii chinokurudzirwa negwaro seyakanakisa yekutanga sosi yemakesi eval?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. Chii chinokurudzirwa negwaro seyakanakisa yekutanga sosi yemakesi eval?
    • Mibvunzo yakagadzirwa neLLM chete
    • Public benchmark leaderboards
    • Mameseji asina kujairika akaraswa kubva painternet
    • Kushandiswa chaiko, senge matanda, matikiti ekutsigira uye mibvunzo yekutsvaga
  2. Ndepapi papi rubriki yakakodzera kupfuura mhinduro imwechete yegoridhe?
    • Zvebasa rechikamu rine mavara akaiswa
    • Kune mabasa akazaruka apo akawanda akasiyana mazwi anogona kuve akarurama
    • Yekutora invoice nhamba chaiyo
    • Rubriki haina kumbonyanya kufanira
  3. Ndeipi yeiyi inonyorwa zvakanaka rubriki mucherechedzo?
    • Inobatsira
    • Inonzwika zvakasikwa
    • Inotaura zuva rekupedzisira rekudzorera
    • Ndeyemhando yepamusoro
  4. Nemakesi zana ekupasa/kufoira uye mwero wekupasa uri pedyo ne80 muzana, gwara rinoti chii nezvemuganhu wekukanganisa?
    • Iyo ingangoita kuwedzera kana kubvisa 8 muzana mapoinzi, saka maviri-mapoinzi ekuvandudza anoita seruzha
    • Inenge yekuwedzera kana kubvisa 0.1 muzana mapoinzi
    • Ndiyo zero chaiyo
    • Kunenge kuri kuwedzera kana kubvisa 50 percentage points
  5. Chii chinangwa cheregression slice?
    • Kudzima makesi ekare otomatiki
    • Kuti ikurumidze mhinduro dzemuenzaniso
    • Kuchengeta kutadza kwakapfuura museti saka zvigadziriso zvinogara zvakaedzwa
    • Kudzidzisa muenzaniso pane zvawo kukanganisa
  6. Chii chaunofanira kuita usati wavimba nemutongi weLLM kugiresa zvinhu zverubriki?
    • Simudza tembiricha yemutongi
    • Bvisa rubriki kuitira kuti mutongi asarudze akasununguka
    • Edzai mutongi panyaya imwe chete
    • Itai kuti vanhu vanyore muenzaniso uye vayera kuti mutongi anobvumirana navo kakawanda sei
  7. Sei uchichengeta chikamu chakavharirwa chedataset chausingatarise?
    • Kuti udzivise overfitting zvinokurudzira kune test set
    • Kuchengetedza nzvimbo yekuchengetedza
    • Nokuti mitemo inoda izvozvo
    • Kuderedza latency
  8. Nei kuenzanisa kwakapetwa pamakesi akafanana kuchibatsira kana uchienzanisa mavhezheni maviri?
    • Vanobvisa kudiwa chero grade
    • Vanowanzoda mienzaniso mishoma pane kuenzanisa masampuli akazvimirira
    • Vanobvisa zvese zvisingaite kubva mumienzaniso yakabuda
    • Vanovimbisa zvibodzwa zvakakwana