Idanwo ti o sopọ mọ itọsọna · Alabọde Ipele

AI Idanwo Iran adanwo

Assess test-oracle limits, characterization tests, symbolic and LLM test generation, fuzzing, and coverage guidance. Check practical limits.

Jẹmọ itọsọna awọn ọnaAI igbeyewo generation
Ibeere 1 ti 8

Kini 'iṣoro oracle' ni iran idanwo AI?

Awotẹlẹ gbogbo ibeere8 ibeere

Awọn idahun ati awọn alaye han bi o ṣe n mu ibeere naa.

  1. Kini 'iṣoro oracle' ni iran idanwo AI?
    • Mọ awọn ti o tọ reti o wu fun a fi fun input
    • Ṣiṣẹda awọn igbewọle laileto to lati ṣiṣẹ eto naa
    • Nsopọ olusare idanwo si ibi ipamọ data
    • Yiyan ede siseto lati ṣe idanwo ni
  2. Kini 'idanwo iwa-ara' tiipa?
    • Awọn sare ṣee ṣe asiko isise
    • Ihuwasi lọwọlọwọ ti koodu bi ipilẹ ipadasẹhin
    • Awọn atilẹba onkowe ká ifaminsi ara
    • A lodo mathematiki atilẹba ti o ti titunse
  3. What programming language did the TestPilot study implement and evaluate its LLM test-generation approach for?
    • Ipata
    • Fortran
    • JavaScript
    • SQL only
  4. Ewu bọtini ti gbigba awọn idanwo ti ipilẹṣẹ AI laisi atunyẹwo ni pe wọn le:
    • Ṣiṣe ju laiyara lati jẹ wulo
    • Pa koodu orisun rẹ laifọwọyi
    • Nikan ṣiṣẹ ni awọn ipari ose
    • Sọ ati di awọn idun ti o wa tẹlẹ bi ẹnipe wọn tọ
  5. Bawo ni awọn oluranlọwọ idanwo orisun LLM bii Copilot ṣe agbejade idanwo kan?
    • Nipa asọtẹlẹ koodu idanwo lati iṣẹ ati agbegbe agbegbe
    • Nipa iṣeduro ni deede pe koodu naa jẹ deede
    • Nipa wiwọn Sipiyu otutu
    • Nipa gbigbasilẹ awọn Olùgbéejáde ká iboju
  6. Iruju-idari-ilabo n dari awọn igbewọle laileto nipa lilo:
    • User star-wonsi
    • Ohun elo koodu ti o ṣe iwọn awọn ẹka ti o kọlu
    • Awọn alakoso oṣupa
    • Orukọ faili nikan
  7. What did the TestPilot evaluation report as its median statement and branch coverage?
    • 100% statement and branch coverage on every package
    • 0% statement coverage and 52.8% branch coverage
    • 70.2% statement coverage and 52.8% branch coverage across its studied packages
    • The paper did not measure code coverage
  8. What does mutation testing assess about a test suite?
    • Whether every test uses the same name
    • Whether a characterization test preserves all current behavior
    • Whether the fuzzer can reach a branch without running tests
    • Whether tests detect small, deliberate changes made to the program