Overview of Self-Evolving Agents There is a huge interest in moving...

It maps the field’s trajectory, proposes “Three Laws” to keep evolution safe and useful, and organizes techniques across single-agent, multi-agent, and domain-specific settings.
MOP (Model Offline Pretraining): Static pretraining on large corpora; no adaptation after deployment.
MOA (Model Online Adaptation): Post-deployment updates via fine-tuning, adapters, or RLHF.
MAO (Multi-Agent Orchestration): Multiple agents coordinate through message exchange or debate, without changing model weights.
MASE (Multi-Agent Self-Evolving): Agents interact with their environment, continually optimising prompts, memory, tools, and workflows.
Techniques are grouped into:
(i) LLM behavior (training for reasoning; test-time scaling with search and verification),
(ii) prompt optimization (edit, generate, text-gradient, evolutionary),
(iii) memory optimization (short-term compression and retrieval; long-term RAG, graphs, and control policies), and
(iv) tool use and tool creation.
Beyond manual pipelines, the survey treats prompts, topologies, and backbones as searchable spaces.
It distinguishes code-level workflows and communication-graph topologies, covers unified optimization that jointly tunes prompts and structure, and describes backbone training for better cooperation.
Benchmarks span tools, web navigation, GUI agents, collaboration, and specialized domains; LLM-as-judge and Agent-as-judge reduce evaluation cost while tracking process quality.
The paper stresses continuous, evolution-aware safety monitoring and highlights challenges such as stable reward modeling, efficiency-effectiveness trade-offs, and transfer of optimized prompts/topologies to new models or domains.
Paper: arxiv.org/abs/2508.07407








