Kvíz spojený s průvodcem · Střední úroveň

Why a Prompt Works in One Model but Not Another Quiz

Test prompt portability across models with matched cases, version records, and application-specific quality, format, and safety criteria.

Související vodicí cestyPrompt Portability Across Models
Otázka 1 z 8

Why might the same prompt behave differently across two models?

Náhled každé otázky8 otázky

Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.

  1. Why might the same prompt behave differently across two models?
    • The words in the prompt change automatically
    • All models use identical internal behavior
    • Models can differ in instruction following, training, features, and API defaults
    • A prompt is always model independent
  2. Does API compatibility guarantee identical model behavior?
    • Yes, compatible requests must produce the same text
    • Yes, if the models share a context window
    • No, because API compatibility is impossible
    • No; request formats can match while outputs and supported features differ
  3. How can a team compare prompts across models fairly?
    • Use a different test set for every model
    • Use the same task examples, relevant settings, and scoring criteria
    • Porovnávejte pouze marketingové popisy
    • Spusťte jednu výzvu jednou
  4. What should be recorded for a portability test?
    • Exact model identifiers, versions, settings, and test date
    • Only the prompt’s filename
    • Only average response length
    • Po nasazení nic
  5. Which feature may differ even when APIs look similar?
    • The fact that prompts contain text
    • Whether a request has an input
    • Structured-output support or tool-call behavior
    • The concept of evaluation
  6. How should a model-specific prompt adjustment be evaluated?
    • Assume it improves all tasks
    • Change it in a controlled way and test against a holdout set
    • Tune on every evaluation case
    • Delete the baseline prompt
  7. Does a prompt that ports on simple tasks automatically port on safety-sensitive tasks?
    • Yes, if the wording is the same
    • Yes, because safety rules are universal
    • No, because simple tasks cannot be evaluated
    • No; safety and tool behavior require their own tests
  8. What should a team do after a model or provider update?
    • Rerun regression tests on the application’s requirements
    • Assume previous scores still apply
    • Only change the model name
    • Remove the evaluation set