引導式測驗 · 中等 等級

CUAD 和法律 NLP 資料集測驗

測試 CUAD 的語料庫和標籤、基準範圍、許可證和資料集限制、分割設計、評估和法律審查邊界。

相關引導路徑Cuad 合約理解資料集
問題 1 的 8

Atticus 計畫如何描述 CUAD v1?

預覽每個問題8 問題

當您參加測驗時,就會出現答案和解釋。

  1. Atticus 計畫如何描述 CUAD v1?
    • 510 個商業合同,帶有標籤元數據,但沒有手動註釋的條款範圍
    • 510 份商業合同,包含 41 種條款類型的 13,000 多個標籤
    • 標有契約法原則的法院意見集
    • 不含註釋條款範圍的完整合約風險評分資料集
  2. 建立 CUAD 是為了支援哪一項任務?
    • 找到顯著的合約語言以進行人工審查
    • 將協議分類為跨司法管轄區可執行或不可執行
    • 僅提取當事人名稱和日期,不提取條款級文本
    • 預測哪些合約糾紛將提交法庭
  3. 模型在 CUAD 上得分很高。這最直接說明了什麼?
    • 該模型對現行法律下的所有 41 種條款類型進行了合法解釋
    • That it generalizes to every contract type and jurisdiction
    • Performance on the benchmark task and data under the reported evaluation setup
    • That an expert-labelled score clears the model for transaction deployment
  4. 為什麼在使用 CUAD 進行評估之前檢查分割設計?
    • A train/test split makes template overlap irrelevant to generalization
    • Related templates or documents across splits can make results look better than generalization warrants
    • The benchmark cannot be trained on when labels are present in the test set
    • Split design alone establishes that results apply to new contract populations
  5. 一位律師想要在另一個司法管轄區的保密協議中使用經過 CUAD 訓練的模型。下一步最好的步驟是什麼?
    • Evaluate only common CUAD clauses and assume they represent NDA language
    • Use a held-out CUAD split from the same source and treat it as proof of jurisdictional transfer
    • Change the jurisdiction metadata and reuse the original score without testing
    • Evaluate on representative agreements from that intended setting
  6. Why report results by clause category as well as one aggregate score?
    • A single aggregate is sufficient when the 41 labels have balanced counts
    • An aggregate can hide that extraction works differently across label types
    • A score for each clause type by itself guarantees transfer to new agreements
    • Category breakdowns are needed only when overall accuracy falls below chance
  7. What should a researcher check before redistributing CUAD data?
    • The dataset version and license terms stated by its maintainers
    • Assume a top-level code license covers every dataset and annotation file
    • Treat public availability as permission to redistribute without checking conditions
    • Use the model’s license as the data license for CUAD
  8. Do CUAD’s expert annotations certify that any model output is legally correct for a live contract?
    • Yes; lawyer-supervised labels certify future model decisions
    • Yes; the dataset covers 41 clause types, so all contract risks are included
    • No; labels support research but do not certify future outputs or legal conclusions
    • Yes, when benchmark scores are high on the labeled categories