Deception is one of the most concerning behaviors that advanced AI...

@SharonYixuanLi
Sharon Li@SharonYixuanLi
7 views Oct 26, 2025 ~2 min read
Advertisement
1
Deception is one of the most concerning behaviors that advanced AI systems can display. If you are not concerned yet, this paper might change your view.

We built a multi-agent framework to study:
👉 How deceptive behaviors can emerge and evolve in LLM agents during realistic long-horizon interactions?

🎯 Motivation
When we talk about AI deception, we mean an AI can produce outputs that mislead someone — deliberately or strategically — to achieve a goal or avoid a consequence.

Examples:
🕵️ Intentionally hiding part of the truth (to make itself look more successful)
🤐 Giving vague answers so it can’t be blamed later
🧢 Saying something false to pass a “test” or finish a task

Most evaluations look at one-shot prompts. But deception doesn’t always show up in a single exchange.
It can develop gradually over time — as the model plans, reacts to pressure, or tries to “look good” under supervision.

That’s the gap we wanted to study.
----------------------------
🧪 Our framework

We built a multi-agent simulation with three key roles:

1. Performer agent — the agent completing complex, interdependent tasks.

2. Supervisor agent — tracking progress and forming trust judgments as the interaction unfolds.

3. Deception auditor — independently reviewing the entire trajectory to detect deceptive behaviors.

This setup enables us to observe not only whether deception occurs, but also how it emerges, escalates, and erodes trust over extended periods.

📊 What we found

- Deception is model-dependent — some models are more prone to engage in deceptive strategies than others (see Table for more).
- Deceptive behaviors are more likely under event pressure (when the performer faces setbacks or high-stakes conditions).
- Deception systematically erodes supervisor trust across long horizons.

🤝 Closing thoughts
Our work doesn’t claim to solve deception — it’s a step toward understanding it in more realistic, dynamic settings.

We hope this simulation framework becomes a foundation for the field: a practical way to evaluate long-horizon deception, a strong baseline that future safety research can build on, and a concrete tool to help guide governance discussions around responsible AI systems.

-------
Huge shout-out to Yang Xu, @xuanmingzhangai, @Samuel861025 for driving this work forward over the last few months. We’re also grateful to our collaborators (@jwaladhamala, Ousmane Dia, @rahul1987iit) at @amazon AGI team supporting and contributing to this work.

📝 “Simulating and Understanding Deceptive Behaviors in Long-Horizon Interactions”
📄 arxiv.org/abs/2510.03999
Code: github.com/deeplearning-w…

#AI #LLM #Deception #Trust #AIethics #AgenticAI #AIResearch
Media image
Actions
What You Can Do
  • Export as PDF or Markdown
  • Batch Export to Notion
  • Bookmark & Highlight
  • Screenshot Tweet
Create Free Account

Includes 7-day Premium trial

Advertisement