引導式測驗 · 硬 等級
模型風險管理 (SR 11-7) 和 AI 測驗
測試 SR 11-7 的三個驗證要素:有效挑戰、供應商模型期望以及銀行如何定義 LLM 模型的邊界。
問題 1 的 8
哪份 OCC 文件與聯邦儲備局的 SR 11-7 同時於 2011 年發布?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- 哪份 OCC 文件與聯邦儲備局的 SR 11-7 同時於 2011 年發布?
- OCC Bulletin 2013-29
- The Comptroller's Handbook on Liquidity
- OCC Bulletin 2011-12
- OCC Interpretive Letter 1170
- SR 11-7 下驗證的三個核心要素是什麼?
- Evaluating conceptual soundness, ongoing monitoring, and outcomes analysis
- Data collection, model training, and deployment
- Board approval, vendor certification, and annual audit
- Stress testing, capital planning, and liquidity review
- SR 11-7 要求什麼樣的審查才能算作「有效挑戰」?
- That the model developer approves their own work
- That a vendor certifies the model
- That the model passes a public benchmark
- That reviewers are objective, informed, competent and have enough influence to force changes
- 銀行應如何處理其專有細節被隱藏的供應商模型?
- Exempt it from validation because the vendor is responsible
- Rely more on sensitivity analysis, benchmarking and outcomes testing
- Use it only for internal reporting
- Replace it with a model built in-house immediately
- 根據指引,以下哪項屬於 LLM 應用程式的模型邊界,屬於變更管理?
- The bank's office locations
- The customer's device type
- The system prompt and retrieval corpus
- The validator's job title
- Why does the guide recommend running repeated samples when testing an LLM?
- Its outputs can vary between runs, so the spread needs to be measured
- Regulators require exactly ten runs
- Repeated runs make the model more accurate
- It reduces the vendor's licensing fees
- Why does the guide say SR 11-7 applies to AI even though it was written in 2011?
- Congress amended it in 2023
- Its definition of a model is technology-neutral
- It names neural networks explicitly
- AI vendors requested it
- When did the FDIC adopt the SR 11-7 model risk guidance?
- 2008
- 2011
- 2014年
- 2017