Guide-yakabatana mibvunzo · Pakati Nhanho

SWE-bhenji uye Coding Agent Benchmarks Quiz

Inoongorora kuti SWE-bhenji mabasa anovakwa sei, FAIL_TO_PASS uye PASS_TO_PASS zvibodzwa, Lite uye Verified subsets, uye nei masikafu achichinja zvabuda.

Nzira dzekutungamira dzinoenderanaSwe Bhenji Uye Coding Agent Benchmarks
Mubvunzo 1 ye 8

Chii chinokumbirwa neSWE-bhenji kuti sisitimu iite?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. Chii chinokumbirwa neSWE-bhenji kuti sisitimu iite?
    • Nyora raibhurari itsva kubva pane zvakatemwa
    • Gadzira chigamba chinogadzirisa chaiyo GitHub nyaya mune Python repository.
    • Pindura mibvunzo yakawanda-yesarudzo nezvekodhi
    • Shandura kodhi kubva kuPython kuenda kuJava
  2. FAIL_TO_PASS bvunzo chii?
    • Miedzo inogara ichikundikana
    • Inoedza mumiririri anozvinyora
    • Miedzo inodarika panguva yekupihwa zvibodzwa
    • Miedzo yakakundikana pamberi pekugadzirisa kwevanhu uye yakapfuura shure kwayo
  3. Ndeipi basa rePASS_TO_PASS bvunzo?
    • Kutarisa kuti chigamba hachina kutyora hunhu hwakatoshanda
    • Kutarisa maitiro ekodhi yechigamba
    • Kuyera kuti chigamba chinomhanya sei
    • Kuongorora nyaya yacho ndeyechokwadi
  4. Chii chinonzi SWE-bhenji Yakasimbiswa?
    • Iyo yakazara seti ye2,294 mabasa
    • Seti yeJavaScript mabasa ane skrini
    • 500 mabasa akaongororwa nemainjiniya evanhu kubvisa nyaya dzisina kujeka uye bvunzo dzisina kunaka
    • A private test set haana kumboburitswa pachena
  5. Mangani ezviitiko ari muSWE-bhenji Lite?
    • 164
    • 300
    • 500
    • 2,294
  6. Sei iyo imwe modhi ichigona kuwana akasiyana zvakanyanya SWE-bhenji zvibodzwa?
    • Zvibodzwa zvinoenderana nechikafu chinotendera iyo modhi kuongorora, kumhanya mirairo uye kugadzirisa mafaera
    • Iwo maedzo anogadzirwa zvisina tsarukano kumhanya kwega kwega
    • Iwo marepositori akasiyana kune yega yega modhi
    • Saizi yemodhi chete ndiyo inokanganisa zvibodzwa
  7. Ndechipi chinodzikisira chaicho chepakutanga SWE-bhenji?
    • Haina miyedzo
    • Inoshandisa chete nyaya dzekugadzira
    • Haikwanise kumhanya muDocker
    • Iyo Python-chete uye yakatorwa kubva kune gumi nemaviri repositori
  8. Mumiririri anoona here chigamba chekuongorora paanenge achishanda?
    • Hongu, inosanganisirwa mune chinyorwa chinyorwa
    • Hongu, asi PASS_TO_PASS bvunzo chete
    • Aiwa, iyo harness inoshandisa chigamba chekuyedza zvakasiyana mushure mechigamba chemumiririri
    • Kwete, nekuti SWE-bhenji haina bvunzo