AI Glossary Term
What does “Jailbreak” mean?
A prompt technique intended to bypass a model's safety constraints.
How Jailbreak works
Example
A user tells a chatbot to pretend to be a character with no rules, hoping it will answer something it would normally refuse. Developers study such prompts and retrain or add filters so similar attempts fail.
Why it matters
Jailbreaks show the limits of safety training. Understanding them helps teams build layered defenses rather than relying on one rule.
Common questions
Is a jailbreak the same as prompt injection?
Related but different. A jailbreak targets the model's own safety rules. Prompt injection hides instructions in content to hijack an application's task.
Are jailbreaks illegal?
Not necessarily, but they usually violate terms of service, and using one to get content for illegal purposes can be illegal.
Can models be made jailbreak-proof?
No known method is perfect. Providers use training, filters, monitoring, and red teaming to reduce successful attacks.