Maswali yanayounganishwa na mwongozo · Kati Kiwango

Kugeuza Laana katika Maswali ya LLMs

Hujaribu kukumbuka ukweli wa mwelekeo, hoja zilizogeuzwa, mpangilio wa mafunzo, vidhibiti vya majaribio na vikomo vya matokeo ya laana ya kugeuza.

Njia za mwongozo zinazohusianaLaana ya Kubadilisha Katika LLMs
Swali 1 ya 8

A model learned “A is B” but fails to answer “B is A.” What is this called?

Hakiki kila swali8 maswali

Majibu na maelezo huonekana unapojibu maswali.

  1. A model learned “A is B” but fails to answer “B is A.” What is this called?
    • The lost-in-the-middle effect
    • Catastrophic forgetting
    • The reversal curse
    • Kukunja kwa hali
  2. What does the reversal curse show about directional associations?
    • Learning one word order does not guarantee reliable recall in the reverse order
    • Language models automatically invert every relation
    • A fact is always stored as a symmetric database edge
    • Fine-tuning removes all directional errors
  3. Is the reversal curse simply a failure because the model never saw the fact?
    • Yes, the model must not have read it
    • It is caused only by a short context window
    • It occurs only when facts are false
    • No; it can fail in reverse even after training on the forward statement
  4. Why might next-token training contribute to the effect?
    • It encodes all facts into an unordered table
    • It trains on token order, so A-followed-by-B does not automatically teach B-followed-by-A
    • It optimizes reverse queries by default
    • It prevents memorization of entity names
  5. How can the effect be tested?
    • Compare model performance on matched forward and reverse versions of facts
    • Measure only the forward statement
    • Change both the entities and question at once
    • Use only a general language benchmark
  6. What does failure on a reverse query imply about model knowledge?
    • The model has no information about either entity
    • The model is necessarily incapable of reasoning
    • The model’s learned association may not support flexible inversion
    • Every entity relation is symmetric
  7. Why is a reverse-direction test useful for a factual QA system?
    • All questions use the same word order
    • Users may ask for either endpoint of a relation
    • It measures image classification accuracy
    • It guarantees factual truth
  8. What should be inferred from one model’s reversal-cursed answer?
    • All language models fail on every reversed fact
    • The model has no semantic representations
    • The relation must be false
    • A documented failure mode to test, not proof that every model or fact behaves identically