Útmutatóhoz kapcsolódó kvíz · Kemény Szint

BloombergGPT and Financial LLMs Quiz

Understand BloombergGPT’s research setup, compare financial and general models, and evaluate finance outputs against dated source evidence.

Kapcsolódó útmutató utakBloomberggpt And Financial LLMs
kérdés 1 -ból 8

What did the BloombergGPT paper report about its pretraining data?

Tekintse meg az összes kérdést8 kérdéseket

A válaszok és magyarázatok megjelennek a kvíz kitöltésekor.

  1. What did the BloombergGPT paper report about its pretraining data?
    • A mixture of financial and general-purpose text
    • Only private analyst recommendations
    • Only unlabeled stock-price time series
    • A corpus consisting entirely of SEC filings
  2. What does a strong score on one financial benchmark establish?
    • The model is safe for every trading decision
    • Performance on that benchmark under its test setup
    • That every financial fact is current
    • That a model will outperform on all languages
  3. Why evaluate numerical extraction separately from fluent summaries?
    • Fluency guarantees arithmetic
    • Numbers do not appear in financial documents
    • A polished summary can still contain an incorrect figure or period
    • Numerical tests cannot use source documents
  4. How should a retrieved filing be used in a financial LLM workflow?
    • Assume the model will calculate every figure correctly
    • Remove the filing date to simplify the prompt
    • Treat a citation as investment advice
    • Verify claims and calculations against the dated filing
  5. Which evaluation set is useful when comparing general and finance-specialized models?
    • The same representative held-out examples for both models
    • Different questions chosen to favor each model
    • Only prompts used during training
    • A set containing only easy positive cases
  6. Why check a financial model for temporal leakage?
    • To make its output more persuasive
    • Future information in a test example can make results look unrealistically strong
    • To remove all source documents
    • It is required to increase model size
  7. What should a model do when asked about a figure in a filing?
    • Invent a likely number when retrieval fails
    • Hide the currency and period
    • Preserve units and reporting period and support the figure with the source
    • Use a recent figure from another company
  8. How should teams use BloombergGPT’s published benchmark findings?
    • As a guarantee for every financial task
    • As proof proprietary data always improve models
    • As a replacement for their own validation
    • As evidence limited to the benchmarks and methods reported