quiz bu lëkkale ak tegtal · Dëgër Niveau
Royuwaayu doxal risk (SR 11-7) ak quiz IA
Test SR 11-7's ñetti mbir yu baax, jafe-jafe yu am solo, xaar-xaaru xeetu jaaykat, ak ni bànk yi di fësalee peggu xeetu LLM.
Laaj 1 de 8
Ban këyitu OCC lañu génne ci wetu SR 11-7 bu Reserve Federal ci 2011?
Xoolaatal laaj bu nekk8 laaj
Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.
- Ban këyitu OCC lañu génne ci wetu SR 11-7 bu Reserve Federal ci 2011?
- OCC Bulletin 2013-29
- The Comptroller's Handbook on Liquidity
- OCC Bulletin 2011-12
- OCC Interpretive Letter 1170
- Lan mooy ñetti mbir yu am solo yi ci wàllu SR 11-7?
- Evaluating conceptual soundness, ongoing monitoring, and outcomes analysis
- Data collection, model training, and deployment
- Board approval, vendor certification, and annual audit
- Stress testing, capital planning, and liquidity review
- Lan la SR 11-7 laaj ngir ñu mëna ko jàppee ni "jafe-jafe bu am solo"?
- That the model developer approves their own work
- That a vendor certifies the model
- That the model passes a public benchmark
- That reviewers are objective, informed, competent and have enough influence to force changes
- Nan la bànk wara def ak modelu jaaykat buñu tëye ay leeral ci moomeel gi?
- Exempt it from validation because the vendor is responsible
- Rely more on sensitivity analysis, benchmarking and outcomes testing
- Use it only for internal reporting
- Replace it with a model built in-house immediately
- Sunu sukkandikoo ci tegtal bi, ban ci ñoom moo bokk ci xeetu àppu LLM ngir doxal coppite?
- The bank's office locations
- The customer's device type
- The system prompt and retrieval corpus
- The validator's job title
- Why does the guide recommend running repeated samples when testing an LLM?
- Its outputs can vary between runs, so the spread needs to be measured
- Regulators require exactly ten runs
- Repeated runs make the model more accurate
- It reduces the vendor's licensing fees
- Why does the guide say SR 11-7 applies to AI even though it was written in 2011?
- Congress amended it in 2023
- Its definition of a model is technology-neutral
- It names neural networks explicitly
- AI vendors requested it
- When did the FDIC adopt the SR 11-7 model risk guidance?
- 2008
- 2011
- 2014
- 2017