What does “Positional Encoding” mean?

A positional encoding method that rotates query and key vectors to encode relative token positions.

A positional bias method that penalizes attention scores based on token distance, helping models extrapolate to longer contexts.

Methods that adapt models by training a small subset of added parameters.

A hypothetical AI system that can perform most intellectual tasks at a human level across many domains.

A software system that can observe, reason, and take actions to achieve a goal, often using tools and memory.

Human-added labels or metadata used to train or evaluate machine learning models.