quiz bu lëkkale ak tegtal · Dëgër Niveau

Tolluwaayu gis-gis yi ci jumtukaayi IA yu yoon

Dafay saytu naka la njàngum Stanford di màndargaale ak natt ay gis-gis yu jub ci IA, lan mooy tontu yu jaarul yoon, ak lu tax jikkoom yu yokk yi ba leegi di lajj.

Laaj 1 de 8

naka la Stanford "amul ay xalaat yu jaarul yoon?" Jàngat luy tekki ab gis-gis bu jaarul yoon?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. naka la Stanford "amul ay xalaat yu jaarul yoon?" Jàngat luy tekki ab gis-gis bu jaarul yoon?
    • Any answer longer than the source document
    • An answer that is either incorrect or misgrounded
    • Only a citation to a case that does not exist
    • Any answer the tool took more than a minute to produce
  2. Ci wallu njàngum Stanford, lan mooy tontu bu 'baaxul'?
    • An answer that refuses to respond
    • An answer written in the wrong language
    • An answer with no citations at all
    • An answer that cites a real source that does not support its claim
  3. Ban jumtukaay moo gëna mëna def ci test Stanford bu 2024 waaye ba leegi mingi xalaat lu ëppu 17 pursaa ci laaj yi?
    • Lexis+ AI
    • Westlaw AI-Assisted Research
    • Ask Practical Law AI
    • GPT-4 used as a comparison
  4. Ban xeetu gis-gis la "Fiksion yu Yoon yu Mag yi" gis ci chatbots yu bari ci laaji tribunal federal yuñ mëna saytu?
    • 1 to 3 percent
    • 17 to 33 percent
    • 69 to 88 percent
    • 95 to 100 percent
  5. Lan moo waral ab jéego buy seet mën na gis kiliftéef bu jaarul yoon doonte base de done amna ki gën?
    • Legal databases are encrypted and cannot be searched
    • Retrieval only works for statutes, not cases
    • Retrieval ranks documents alphabetically
    • Retrieval matches similar wording or meaning, which is not the same as legal relevance
  6. What tendency did the research find when questions contained a false premise?
    • Models tended to accept the premise and answer as if it were true
    • Models always corrected the premise
    • Models refused every such question
    • Models replied only with the text of the relevant statute
  7. Which mitigation specifically helps flag a cited case that was later reversed or overruled?
    • Raising the model's temperature setting
    • Making answers shorter
    • Translating the query into another language
    • Connecting a citator such as KeyCite or Shepard's
  8. What marketing claim did the Stanford study's title directly question?
    • That legal AI tools were cheaper than paralegals
    • That some tools were 'hallucination-free'
    • That legal AI could pass the bar exam
    • That AI tools were approved by courts