ДаліНаступний посібник
Indirect Prompt Injection
технічний
Технічний КЕРІВНИЦТВО
The dual-LLM pattern separates an agent’s authority from its exposure to untrusted text: one model can use tools, while another reads hostile or unknown content without tool access.
It aims to limit how prompt injection can cross that boundary, but does not itself prove that extracted data is harmless or make the privileged model immune to other attack paths.
Prompt injection is difficult because instructions and data arrive as language in the same model context. A malicious web page can ask an agent to ignore its task, disclose information, or call a tool; merely telling one model to ignore such text does not create a reliable security boundary. The dual-LLM pattern reduces direct exposure by assigning different permissions. A privileged model plans and acts using approved tools, while a quarantined model reads untrusted documents or pages and has no ability to act. Its response should be narrow, such as a validated price, date, or selected label, rather than a general narrative that could carry hidden instructions back across the boundary. The handoff is the critical design point. Treat the quarantined result as untrusted data, validate its schema and allowed values in ordinary code, and give the privileged model only the fields needed for its decision. Keep tool authorization outside the returned text: an extracted field must not grant a new capability. Log which source produced each value, and require confirmation for consequential actions. Also inspect indirect paths such as retrieved text, tool outputs, conversation memory, and error messages; a second model does not help if raw hostile content reaches the privileged context through another route. This is an architectural pattern, not a guarantee attached to using two models. It adds calls and integration work, and an attacker may still manipulate the extractor, exploit a permissive schema, or reach the acting model through an unreviewed channel. Research such as CaMeL explores stronger system-level boundaries using explicit control and data flow plus capabilities; it is related work, not evidence that every two-model design has CaMeL’s properties. Test the whole workflow with adversarial inputs and verify authorization in code, independently of what either model says.
Архітектурні рішення збільшують продуктивність і експлуатаційні витрати протягом багатьох років.
Технічна освіта допомагає командам вибрати правильний стек, а не лише найновіший.
Кращий інженерний вибір зменшує проблеми з надійністю у виробництві.
Agent security research is moving toward explicit permission systems, typed data flows, and evaluations that exercise complete tool-using workflows. Such mechanisms may make it easier to reason about which data can influence which action, but they still depend on correct implementation and useful tests. Teams adopting a dual-model design should document its actual guarantees, keep a threat model current, and reassess attack paths when they add tools, memory, or new input channels. Security claims should identify the tested workflow and assumptions.
An email assistant lets a no-tools model summarize a message into a strict schema, then asks the tool-enabled model to decide whether to draft a reply using the summary as untrusted input.
A browsing agent asks a quarantined model to extract a requested price from a page; the privileged agent receives the value and a source reference, not the page’s raw instructions.
A document workflow validates extracted invoice fields against expected types and ranges before a separate service can create a payment request.
A security review maps every route by which web content, attachments, model output, or tool results can reach a privileged decision, then tests whether the boundaries actually hold.
Оптимізація одного тесту може приховати ширші слабкі сторони системи.
Витрати на інфраструктуру та обслуговування часто недооцінюються.
Прогалини в безпеці та спостережуваності можуть зростати в міру ускладнення систем.
Визначте цільові показники затримки, якості та вартості перед впровадженням.
Тест за реалістичних умов навантаження та даних.
Моніторинг інструментів на наявність помилок, дрейфу та впливу користувача.
Перед масштабуванням підготуйте шляхи відкату та реагування на інциденти.
Free newsletter
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
The dual-LLM pattern separates an agent’s authority from its exposure to untrusted text: one model can use tools, while another reads hostile or unknown content without tool access. It aims to limit how prompt injection can cross that boundary, but does not itself prove that extracted data is harmless or make the privileged model immune to other attack paths.
The privileged model holds the approved tool capability; the quarantined reader has no ability to act.
The guide explains that instruction and data text share a language context, so a model may follow attacker-supplied directions.
A narrow typed value provides less space for hidden instructions and can be validated by application code.
Model output remains untrusted data; ordinary code should validate fields and authorization before an action.
The pattern can leave exploitable paths through extraction, permissive schemas, or unreviewed channels.
Продовжуйте вчитися
Інші посібники, вибрані для цієї теми
ДаліНаступний посібник
Indirect Prompt Injection
технічний