引導式測驗 · 中等 等級
CUAD 和法律 NLP 資料集測驗
測試 CUAD 的語料庫和標籤、基準範圍、許可證和資料集限制、分割設計、評估和法律審查邊界。
問題 1 的 8
Atticus 計畫如何描述 CUAD v1?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- Atticus 計畫如何描述 CUAD v1?
- 510 個商業合同,帶有標籤元數據,但沒有手動註釋的條款範圍
- 510 份商業合同,包含 41 種條款類型的 13,000 多個標籤
- 標有契約法原則的法院意見集
- 不含註釋條款範圍的完整合約風險評分資料集
- 建立 CUAD 是為了支援哪一項任務?
- 找到顯著的合約語言以進行人工審查
- 將協議分類為跨司法管轄區可執行或不可執行
- 僅提取當事人名稱和日期,不提取條款級文本
- 預測哪些合約糾紛將提交法庭
- 模型在 CUAD 上得分很高。這最直接說明了什麼?
- 該模型對現行法律下的所有 41 種條款類型進行了合法解釋
- That it generalizes to every contract type and jurisdiction
- Performance on the benchmark task and data under the reported evaluation setup
- That an expert-labelled score clears the model for transaction deployment
- 為什麼在使用 CUAD 進行評估之前檢查分割設計?
- A train/test split makes template overlap irrelevant to generalization
- Related templates or documents across splits can make results look better than generalization warrants
- The benchmark cannot be trained on when labels are present in the test set
- Split design alone establishes that results apply to new contract populations
- 一位律師想要在另一個司法管轄區的保密協議中使用經過 CUAD 訓練的模型。下一步最好的步驟是什麼?
- Evaluate only common CUAD clauses and assume they represent NDA language
- Use a held-out CUAD split from the same source and treat it as proof of jurisdictional transfer
- Change the jurisdiction metadata and reuse the original score without testing
- Evaluate on representative agreements from that intended setting
- Why report results by clause category as well as one aggregate score?
- A single aggregate is sufficient when the 41 labels have balanced counts
- An aggregate can hide that extraction works differently across label types
- A score for each clause type by itself guarantees transfer to new agreements
- Category breakdowns are needed only when overall accuracy falls below chance
- What should a researcher check before redistributing CUAD data?
- The dataset version and license terms stated by its maintainers
- Assume a top-level code license covers every dataset and annotation file
- Treat public availability as permission to redistribute without checking conditions
- Use the model’s license as the data license for CUAD
- Do CUAD’s expert annotations certify that any model output is legally correct for a live contract?
- Yes; lawyer-supervised labels certify future model decisions
- Yes; the dataset covers 41 clause types, so all contract risks are included
- No; labels support research but do not certify future outputs or legal conclusions
- Yes, when benchmark scores are high on the labeled categories