Викторина, связанная с руководством · Легко Уровень
Даты прекращения знаний в викторине LLM
Проверяет, что такое ограничение знаний, почему модели неправильно оценивают собственную дату ограничения и как поиск, извлечение и введение данных поддерживают актуальность ответов.
Вопрос 1 из 8
Каков предел знаний модели?
Предварительный просмотр каждого вопроса8 вопросы
Ответы и пояснения появляются по мере прохождения теста.
- Каков предел знаний модели?
- The date the model stops working
- The approximate date after which its training data contains little or no information
- The date the model was released to the public
- The date the vendor ends customer support
- Почему модели часто не уверены или недооценивают свой собственный порог?
- Vendors deliberately hide it from the model
- Models delete their most recent data after training
- Models count days incorrectly
- The final months before the cutoff are thinly represented, because people keep writing about events long afterward
- Каков наиболее надежный способ определить уровень знаний модели?
- Check the vendor's published model documentation
- Ask the model directly
- Count the words in its answers
- Look at the model's logo
- Какое простое решение исправляет многие случаи, когда модель принимает неверную текущую дату?
- Fine-tuning the model every week
- Turning the model off and on
- Putting the current date in the system prompt
- Using shorter prompts
- Чат-бот с просмотром веб-страниц отвечает на вопрос о новостях прошлой недели. Какое утверждение верно?
- Its training cutoff has moved to last week
- It can no longer make factual errors
- It retrains itself on every query
- Its training cutoff is unchanged; it is reading new sources and is only as accurate as the pages it retrieves
- Why is retrieval usually preferred over fine-tuning for keeping facts current?
- Fine-tuning is slower and more costly as a way to keep facts current
- Fine-tuning is impossible for large models
- Retrieval permanently changes the model's weights
- Retrieval works without any documents
- Which of these is a typical sign of stale knowledge?
- The model refuses every question
- The model switches to another language
- The model names an outdated software version as the latest
- The model's answers are unusually short
- When building evals for cutoff-related problems, what should you include?
- Only questions about events well before the cutoff
- Questions whose correct answers changed after the cutoff
- Questions with all dates removed
- A question asking the model to state its cutoff