Guide-linked quiz · Hard Level

BloombergGPT and Financial LLMs Quiz

Understand BloombergGPT’s research setup, compare financial and general models, and evaluate finance outputs against dated source evidence.

Question 1 of 8

What did the BloombergGPT paper report about its pretraining data?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. What did the BloombergGPT paper report about its pretraining data?
    • A mixture of financial and general-purpose text
    • Only private analyst recommendations
    • Only unlabeled stock-price time series
    • A corpus consisting entirely of SEC filings
  2. What does a strong score on one financial benchmark establish?
    • The model is safe for every trading decision
    • Performance on that benchmark under its test setup
    • That every financial fact is current
    • That a model will outperform on all languages
  3. Why evaluate numerical extraction separately from fluent summaries?
    • Fluency guarantees arithmetic
    • Numbers do not appear in financial documents
    • A polished summary can still contain an incorrect figure or period
    • Numerical tests cannot use source documents
  4. How should a retrieved filing be used in a financial LLM workflow?
    • Assume the model will calculate every figure correctly
    • Remove the filing date to simplify the prompt
    • Treat a citation as investment advice
    • Verify claims and calculations against the dated filing
  5. Which evaluation set is useful when comparing general and finance-specialized models?
    • The same representative held-out examples for both models
    • Different questions chosen to favor each model
    • Only prompts used during training
    • A set containing only easy positive cases
  6. Why check a financial model for temporal leakage?
    • To make its output more persuasive
    • Future information in a test example can make results look unrealistically strong
    • To remove all source documents
    • It is required to increase model size
  7. What should a model do when asked about a figure in a filing?
    • Invent a likely number when retrieval fails
    • Hide the currency and period
    • Preserve units and reporting period and support the figure with the source
    • Use a recent figure from another company
  8. How should teams use BloombergGPT’s published benchmark findings?
    • As a guarantee for every financial task
    • As proof proprietary data always improve models
    • As a replacement for their own validation
    • As evidence limited to the benchmarks and methods reported

Keep testing yourself

More quizzes picked for your level.

View all quizzes