Tiếp theoHướng dẫn tiếp theo
Indirect Prompt Injection
kỹ thuật
HƯỚNG DẪN KỸ THUẬT
The sandwich defense repeats or restates the trusted task instruction after untrusted content has been inserted into a prompt.
The closing reminder may reinforce the intended task, but it remains text-based guidance inside the same model context and cannot guarantee that an injection will be ignored.
The sandwich defense places untrusted content between an initial trusted task instruction and a closing repetition or restatement of that instruction. For example, a prompt may ask for a summary, insert an external page, and then remind the model to summarize the page rather than follow directions inside it. This is a prompt-template change: it does not modify the model, create a separate data channel, or restrict tool access. It is easy to test, but it should be treated as a heuristic rather than a security boundary. The intuition is that the final reminder may help the model focus on the intended task after reading the untrusted passage. That does not mean models always follow the last instruction, nor that the closing reminder structurally outranks hostile text. A malicious passage may imitate trusted instructions, contain multiple directives, or exploit behavior not covered by the template. The defense can also fail if the untrusted block enters context through another route that the prompt author did not account for. Evidence is model- and attack-dependent. A 2026 preprint tested prompt sandwiching and other prompt-level defenses against domain-camouflaged injection across three model families and three synthetic deployment domains. It found substantial variation by model, and none of the tested prompt-level defenses eliminated the threat across weaker models. The study is limited to its setup; it is evidence against assuming a universal effect, not a complete ranking for every real system. Use sandwiching only as one layer alongside explicit data handling, permission checks on tools, attack testing, and user confirmation for consequential actions. Measure both resistance and task quality before release.
Các quyết định về kiến trúc sẽ thúc đẩy hiệu suất và chi phí vận hành trong nhiều năm.
Giáo dục kỹ thuật giúp các nhóm chọn nhóm phù hợp chứ không chỉ nhóm mới nhất.
Lựa chọn kỹ thuật tốt hơn làm giảm sự cố về độ tin cậy trong sản xuất.
Prompt-level defenses will remain attractive because they are quick to prototype, but their value will depend on model behavior and the attacks a system encounters. As evaluations improve, teams may get better evidence about when repetition helps. The lasting lesson is to test this pattern within a layered design and retain deterministic limits on what an agent can do. New models may respond differently to the same closing reminder, so validate updates before relying on them. Keep safeguards outside the prompt for consequential actions.
A translation prompt gives the task, inserts a user-provided paragraph, then repeats that the paragraph should be translated rather than obeyed.
A document question-answering workflow states the question, includes a retrieved passage, and restates the requested answer format before generation.
A summarizer tells the model to summarize a forum post, places the post in a marked region, then closes by reiterating that post text is source material.
A security test compares a sandwich prompt with a baseline using the same benign and malicious documents across several model versions.
Tối ưu hóa một điểm chuẩn có thể che giấu những điểm yếu của hệ thống rộng hơn.
Chi phí cơ sở hạ tầng và bảo trì thường được đánh giá thấp.
Khoảng cách về bảo mật và khả năng quan sát có thể tăng lên khi hệ thống trở nên phức tạp hơn.
Xác định các mục tiêu về độ trễ, chất lượng và chi phí trước khi triển khai.
Điểm chuẩn trong điều kiện tải và dữ liệu thực tế.
Giám sát thiết bị về lỗi, độ lệch và tác động của người dùng.
Chuẩn bị đường dẫn khôi phục và ứng phó sự cố trước khi mở rộng quy mô.
Free newsletter
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
The sandwich defense repeats or restates the trusted task instruction after untrusted content has been inserted into a prompt. The closing reminder may reinforce the intended task, but it remains text-based guidance inside the same model context and cannot guarantee that an injection will be ignored.
The guide defines the pattern as a trusted task instruction before and after the untrusted passage.
The guide describes the reminder as a heuristic that may reinforce the task, not a guarantee.
The guide says sandwiching is a prompt-template change, not a model or permission change.
The guide explains that text repetition does not create a separate channel or structural access control.
The guide describes the preprint’s bounded setup: three model families, domains, and synthetic documents.
Tiếp tục học hỏi
Đã chọn thêm hướng dẫn cho chủ đề này
Tiếp theoHướng dẫn tiếp theo
Indirect Prompt Injection
kỹ thuật