Quiz collegato alla guida · Difficile Livello

Quiz su BloombergGPT e LLM finanziari

Comprendi la configurazione della ricerca di BloombergGPT, confronta i modelli finanziari e generali e valuta gli output finanziari rispetto a prove di origine datate.

Percorsi guida correlatiBloomberggpt e LLM finanziari
Domanda 1 di 8

What did the BloombergGPT paper report about its pretraining data?

Anteprima di ogni domanda8 domande

Le risposte e le spiegazioni vengono visualizzate mentre rispondi al quiz.

  1. What did the BloombergGPT paper report about its pretraining data?
    • A mixture of financial and general-purpose text
    • Only private analyst recommendations
    • Only unlabeled stock-price time series
    • A corpus consisting entirely of SEC filings
  2. What does a strong score on one financial benchmark establish?
    • The model is safe for every trading decision
    • Performance on that benchmark under its test setup
    • That every financial fact is current
    • That a model will outperform on all languages
  3. Why evaluate numerical extraction separately from fluent summaries?
    • Fluency guarantees arithmetic
    • Numbers do not appear in financial documents
    • A polished summary can still contain an incorrect figure or period
    • Numerical tests cannot use source documents
  4. How should a retrieved filing be used in a financial LLM workflow?
    • Assume the model will calculate every figure correctly
    • Remove the filing date to simplify the prompt
    • Treat a citation as investment advice
    • Verify claims and calculations against the dated filing
  5. Which evaluation set is useful when comparing general and finance-specialized models?
    • The same representative held-out examples for both models
    • Different questions chosen to favor each model
    • Only prompts used during training
    • A set containing only easy positive cases
  6. Why check a financial model for temporal leakage?
    • To make its output more persuasive
    • Future information in a test example can make results look unrealistically strong
    • To remove all source documents
    • It is required to increase model size
  7. What should a model do when asked about a figure in a filing?
    • Invent a likely number when retrieval fails
    • Hide the currency and period
    • Preserve units and reporting period and support the figure with the source
    • Use a recent figure from another company
  8. How should teams use BloombergGPT’s published benchmark findings?
    • As a guarantee for every financial task
    • As proof proprietary data always improve models
    • As a replacement for their own validation
    • As evidence limited to the benchmarks and methods reported