Daty graniczne wiedzy w quizie LLM

Odpowiedzi i wyjaśnienia pojawiają się w miarę rozwiązywania quizu.

1. Jaki jest próg wiedzy modelu?
   • The date the model stops working
   • The approximate date after which its training data contains little or no information
   • The date the model was released to the public
   • The date the vendor ends customer support
2. Dlaczego modele często nie są pewne lub nie doceniają własnej wartości granicznej?
   • Vendors deliberately hide it from the model
   • Models delete their most recent data after training
   • Models count days incorrectly
   • The final months before the cutoff are thinly represented, because people keep writing about events long afterward
3. Jaki jest najbardziej niezawodny sposób na znalezienie granicy wiedzy modelu?
   • Check the vendor's published model documentation
   • Ask the model directly
   • Count the words in its answers
   • Look at the model's logo
4. Jaka prosta poprawka koryguje wiele przypadków, w których model zakłada niewłaściwą bieżącą datę?
   • Fine-tuning the model every week
   • Turning the model off and on
   • Putting the current date in the system prompt
   • Using shorter prompts
5. Chatbot z przeglądaniem stron internetowych odpowiada na pytanie dotyczące wiadomości z ostatniego tygodnia. Które stwierdzenie jest dokładne?
   • Its training cutoff has moved to last week
   • It can no longer make factual errors
   • It retrains itself on every query
   • Its training cutoff is unchanged; it is reading new sources and is only as accurate as the pages it retrieves
6. Why is retrieval usually preferred over fine-tuning for keeping facts current?
   • Fine-tuning is slower and more costly as a way to keep facts current
   • Fine-tuning is impossible for large models
   • Retrieval permanently changes the model's weights
   • Retrieval works without any documents
7. Which of these is a typical sign of stale knowledge?
   • The model refuses every question
   • The model switches to another language
   • The model names an outdated software version as the latest
   • The model's answers are unusually short
8. When building evals for cutoff-related problems, what should you include?
   • Only questions about events well before the cutoff
   • Questions whose correct answers changed after the cutoff
   • Questions with all dates removed
   • A question asking the model to state its cutoff