ExplainerAgentic systems

When a multi-agent system beats a single agent

Controlled studies of single agent vs multi-agent designs find extra agents help when work splits into independent parts and hurt when each step depends on the last.

Cover of the full report: When a multi-agent system beats a single agent
The research behind this article, with every source listed. 19 pages.

Key points

From the Summary of the full report

  1. Whether a multi-agent system beats a single agent depends on the structure of the task. In 260 controlled configurations, Kim et al. (version 3, April 2026) measured relative changes in mean success from +80.8% on a decomposable financial analysis benchmark to -70.0% on a sequential planning benchmark. The mean across all six benchmarks was -0.3% [11].
  2. Strong single agents narrow the gain. Above about 45% single-agent accuracy, added agents lowered performance [11]. With strong prompts that include demonstrations [3], equal thinking-token budgets [12] or workflows whose agents share one base model [13], one agent matched or beat multi-agent setups. One ICLR 2026 study finds optimized multi-agent building blocks about 6% ahead [10].
  3. Extra agents cost more on every basis measured, from 3 to 10 times a single agent's tokens in one model developer's testing (vendor-reported) to 4 to 220 times the input tokens in one study [14, 23]. At a matched budget, successes per 1,000 tokens fell from 67.7 to between 13.6 and 42.4 [11].

Single agent vs multi-agent comes down to the shape of the task. In Kim et al.'s controlled study of 260 configurations (April 2026), splitting work across agents raised mean success by up to 80.8% relative to one agent on a financial analysis benchmark whose parts could be worked separately. On a planning benchmark where each step depended on the last, it cut mean success by up to 70.0%. Averaged over all six benchmarks, the change was -0.3% [11].

Extra agents also cost more. A model developer reported in June 2025 that its multi-agent research system used about 15 times the tokens of a chat, against about 4 times for a single agent [22]. In three studies, one agent matched or beat multi-agent setups when it got strong prompts with demonstrations [3], the same thinking-token budget [12] or the same base model as the workflow's agents [13]. A fourth found optimized multi-agent designs about 6% ahead [10].

Practitioners who took opposite sides in 2025 now agree on helpers that gather information in parallel and on a separate checker [23, 26, 28]. Security and ownership boundaries can also require separate agents [16, 30].

Single agent vs multi-agent: the common patterns

A single-agent system has one reasoning loop, even when it calls tools or reviews its own work, and a multi-agent system has several model-backed agents that pass structured messages [11].

Pattern Other names How it works
Orchestrator-workers Manager, coordinator, centralized, supervisor A lead agent splits the task, delegates the parts and combines the results [11, 18, 20, 21, 30]
Handoff Decentralized, swarm Peer agents pass control to each other [18, 20, 30]
Parallel Sectioning, fan-out, map-reduce Independent subtasks run at once, then merge [17, 21]
Generator-verifier Evaluator-optimizer, maker-checker One agent produces, another checks it against criteria [17, 21, 24]

Where splitting helps

Splitting helps when the parts do not depend on each other. On the Finance Agent benchmark, revenue, cost and market factors can be analyzed separately, and every multi-agent architecture beat the single agent, by 57% to 80.8% relative [11].

A model developer also reported in June 2025 that a frontier lead model with smaller subagents beat the lead model alone by 90.2% on its internal research evaluation (vendor-reported), with gains on breadth-first queries [22]. In its analysis, token use alone explained 80% of the performance variance on the BrowseComp benchmark [22].

A fresh context helps when one context degrades. Across five models, performance fell by 13.9% to 85% as input length grew, even with perfect retrieval [9]. Under equal budgets, Tran and Kiela found a multi-agent pipeline pulled ahead only after the single agent's context was heavily degraded [12]. Overlapping tools have a similar effect: in an agent-framework maker's test, a single agent's score fell sharply once two or more distractor domains of 19 tools each were added [30].

Where splitting hurts

Splitting hurts when each step depends on the last. On PlanCraft, a crafting-plan benchmark, every multi-agent architecture lost to the single agent, by 39% to 70% relative. Traces show orchestrators breaking short sequential tasks into artificial subtasks and spending the token budget on coordination [11].

Parallel agents that write also collide. A coding-agent developer argued in June 2025 that "actions carry implicit decisions" and that parallel subagents act on "conflicting assumptions not prescribed upfront" [27]. In one experiment with planner, implementer, tester and reviewer agents, "the subagents spent more tokens on coordination than on actual work" [23].

Positions have moved. In April 2026 the coding-agent developer wrote that setups work where "writes stay single-threaded" [28]. In October 2026 the research-system developer reported that a single agent with skills often beat subagent designs in enterprise deployments [26].

Are multi-agent systems better than single agents?

Not on average. Once a single agent already scored above about 45%, Kim et al. found that added agents lowered performance, and the paper treats this ceiling as its robust result [11].

Better prompts close much of the gap. Wang et al. found that discussion beat a single agent only when the prompt had no demonstrations [3]. Gao et al. reran published comparisons with a newer model and saw the accuracy gain fall from 10% to 3% [14].

Zhou et al. disagree in part: optimized multi-agent building blocks beat an optimized single agent by about 6% on average [10].

What extra agents cost

Each source measures cost on its own basis, so the multiples do not combine.

Source and date Comparison Figure
Model developer, June 2025 (vendor-reported) Single agent and multi-agent system against chat About 4x and 15x the tokens [22]
Model developer, January 2026 (vendor-reported) Multi-agent against single agent on equivalent tasks 3x to 10x the tokens [23]
Gao et al., May 2025 Multi-agent against single agent, seven datasets 4x to 220x input tokens [14]
Kim et al., April 2026 Successes per 1,000 tokens at a matched budget 67.7 for one agent, 13.6 to 42.4 for multi-agent designs [11]

Running subagents in parallel, each calling tools in parallel, cut research time by up to 90% for complex queries in one developer's system (vendor-reported, June 2025) [22]. A customer of the same developer measured a single loop running about twice as fast as its multi-agent harness (vendor-reported, October 2026) [26]. The developer also warns that one subagent per team can leave "hundreds of overlapping subagents with no enforced standards and no specific owner" (October 2026) [26].

A separate checker

Kim et al. observed that independent agents amplified errors 17.2 times at the trace level, against 4.4 times when an orchestrator checked outputs before combining them. The effect loses statistical significance once other coordination measures are controlled [11].

A checker needs criteria. A verifier told only to check whether output is good "will rubber-stamp the generator's output" [24]. In the MAST study of multi-agent failures, systems with explicit verifiers showed fewer failures, yet many verifiers ran only superficial checks [8]. A coding-agent developer reported that a separate review agent caught an average of two bugs per pull request, about 58% of them severe, and worked better with no context shared with the coder (vendor-reported, April 2026) [28].

Debate is weaker evidence. Du et al. found that three agents debating for two rounds raised arithmetic accuracy from 67.0% to 81.8%, zero-shot [4]. With the same number of sampled answers, majority voting beat debate in a replication [5], and a NeurIPS 2025 study found that voting accounts for most of the gain credited to debate [7]. Agents with the same model, context and scaffolding also tend to make the same mistakes [25]. For citation checks, see how to check LLM citations against their sources.

Boundaries that justify separate agents

Some reasons sit outside the task. A cloud provider's adoption guide says to start with several agents when a use case crosses security and compliance boundaries, involves several teams or has planned growth. Its example, from financial services, is one agent preparing transactions while another validates them [16]. NIST's separation of duties and least privilege controls cover people and the processes acting for them [1], and the cloud guides apply the same ideas to agents [16, 17]. OWASP advises limiting each agent's tools and permissions, and lists a compromised peer agent as a trigger of excessive agency [2]. When another organization's agent does part of the work, one agent cannot do it all [19, 30].

A model developer offers a counterpoint: each tool can check what the calling user may see or do, so one loop can serve users with different access [26]. MCP access control covers the controls on each tool.

When to use a multi-agent system

Situation What the evidence shows Starting design
Parts can be worked separately Gains of 57% to 80.8% relative on Finance Agent [11] Orchestrator with parallel workers
Each step depends on the last Losses of 39% to 70% relative on PlanCraft [11] One agent
One agent already scores above about 45% Added agents lowered performance [11] One agent with better prompts [3]
Long or misleading context Length alone hurts, and splitting helps once degradation is heavy [9, 12] Read-only helpers with their own context
Many overlapping tools or domains Single agents fall off as domains are added [29, 30] Clarify the tools first, then split by domain [20]
Output must meet explicit criteria Checks help when the criteria are concrete [8, 24] Generator plus verifier
Data isolation, separated duties, another party's agent Required by policy or ownership [1, 16, 30] Separate agents with least privilege

Outside those boundaries, the guides share a first step: build one agent, test it and split only when tests show a limit it cannot pass [16, 18, 20, 26].

Rillor builds agentic systems for evidence-heavy work over large bodies of text and data. A planner splits each question into parts and gives each part to a specialist agent with only the tools that part needs, and an audit step checks every citation against the logged evidence before an answer goes out.

Read the full report

The full report adds Kim et al.'s results by architecture across all 260 configurations, a dated timeline of practitioner positions, each study's limits and all 30 sources.

The full report

When a multi-agent system beats a single agent

The research behind this article, with every source listed. 19 pages.

  1. Summary
  2. Background
  3. Method
  4. Findings
  5. Implications
  6. Limits of this analysis
  7. Sources

Sources

  1. NIST SP 800-53 Rev. 5, Security and Privacy Controls for Information Systems and Organizations, controls AC-5 Separation of Duties and AC-6 Least Privilege. National Institute of Standards and Technology, September 2020, updated 10 December 2020, Release 5.2.0 of 27 August 2025. https://csrc.nist.gov/pubs/sp/800/53/r5/upd1/final
  2. LLM06:2025 Excessive Agency, OWASP Top 10 for LLM Applications 2025. OWASP Gen AI Security Project, viewed 24 October 2026. https://genai.owasp.org/llmrisk/llm062025-excessive-agency/
  3. Wang, Q., Wang, Z., Su, Y., Tong, H. and Song, Y. Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key? Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 6106 to 6131, August 2024. https://aclanthology.org/2024.acl-long.331/
  4. Du, Y., Li, S., Torralba, A., Tenenbaum, J. B. and Mordatch, I. Improving Factuality and Reasoning in Language Models through Multiagent Debate. Proceedings of the 41st International Conference on Machine Learning, PMLR 235, pp. 11733 to 11763, July 2024. https://proceedings.mlr.press/v235/du24e.html
  5. Huang, J., Chen, X., Mishra, S., Zheng, H. S., Yu, A. W., Song, X. and Zhou, D. Large Language Models Cannot Self-Correct Reasoning Yet. ICLR 2024, arXiv 2310.01798 version 2, 14 March 2024. https://arxiv.org/abs/2310.01798
  6. Choi, H. K., Zhu, X. and Li, S. Debate or Vote: Which Yields Better Decisions in Multi-Agent Large Language Models? NeurIPS 2025, arXiv 2508.17536 version 2, 23 October 2025. https://arxiv.org/abs/2508.17536
  7. Cemri, M., Pan, M. Z., Yang, S. and others. Why Do Multi-Agent LLM Systems Fail? NeurIPS 2025 Datasets and Benchmarks Track, arXiv 2503.13657 version 3, 26 October 2025. https://arxiv.org/abs/2503.13657
  8. Du, Y., Tian, M., Ronanki, S. and others. Context Length Alone Hurts LLM Performance Despite Perfect Retrieval. Findings of EMNLP 2025, arXiv 2510.05381, 6 October 2025. https://arxiv.org/abs/2510.05381
  9. Zhou, H., Wan, X., Sun, R. and others. Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies. ICLR 2026, arXiv 2502.02533 version 2, 31 January 2026. https://arxiv.org/abs/2502.02533
  10. Kim, Y., Gu, K., Park, C. and others. Towards a Science of Scaling Agent Systems. arXiv preprint 2512.08296 version 3, 8 April 2026. https://arxiv.org/abs/2512.08296
  11. Tran, D. and Kiela, D. Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets. arXiv preprint 2604.02460 version 2, 11 April 2026. https://arxiv.org/abs/2604.02460
  12. Xu, J., Koesdwiady, A., Bei, S. and others. Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline. arXiv preprint 2601.12307, 18 January 2026. https://arxiv.org/abs/2601.12307
  13. Gao, M., Li, Y., Liu, B. and others. Single-agent or Multi-agent Systems? Why Not Both? arXiv preprint 2505.18286, 23 May 2025. https://arxiv.org/abs/2505.18286
  14. Choosing Between Building a Single-Agent System or Multi-Agent System, Cloud Adoption Framework. Microsoft Learn, updated 27 February 2026. https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/ai-agents/single-agent-multiple-agents
  15. AI Agent Orchestration Patterns, Azure Architecture Center. Microsoft Learn, updated 21 September 2026. https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/ai-agent-design-patterns
  16. Choose a design pattern for your agentic AI system, Cloud Architecture Center. Google Cloud, updated 28 May 2026. https://docs.cloud.google.com/architecture/choose-design-pattern-agentic-ai-system
  17. A2A Protocol, project overview. The Linux Foundation, A2A Protocol project, viewed 24 October 2026. https://a2a-protocol.org/latest/
  18. A practical guide to building agents. OpenAI, April 2025. https://cdn.openai.com/business-guides-and-resources/a-practical-guide-to-building-agents.pdf
  19. Building effective agents. Anthropic, 19 December 2024. https://www.anthropic.com/engineering/building-effective-agents
  20. How we built our multi-agent research system. Anthropic, 13 June 2025. https://www.anthropic.com/engineering/multi-agent-research-system
  21. Building multi-agent systems: When and how to use them. Anthropic, 23 January 2026. https://claude.com/blog/building-multi-agent-systems-when-and-how-to-use-them
  22. Multi-agent coordination patterns: Five approaches and when to use them. Anthropic, 10 April 2026. https://claude.com/blog/multi-agent-coordination-patterns
  23. Patterns and problems in emerging multiagent systems. Anthropic, 13 August 2026. https://www.anthropic.com/research/multiagent-systems
  24. Building agents: When to fold subagents into your main agent loop. Anthropic, 22 October 2026. https://claude.com/resources/articles/building-agents-when-to-fold-subagents-into-your-main-agent-loop
  25. Yan, W. Don't Build Multi-Agents. Cognition, 12 June 2025. https://cognition.ai/blog/dont-build-multi-agents
  26. Yan, W. Multi-Agents: What's Actually Working. Cognition, 22 April 2026. https://cognition.ai/blog/multi-agents-working
  27. Benchmarking Single Agent Performance. LangChain, 10 February 2025. https://blog.langchain.com/react-agent-benchmarking/
  28. Fu-Hinthorn, W. Benchmarking Multi-Agent Architectures. LangChain, 10 June 2025. https://blog.langchain.com/benchmarking-multi-agent-architectures/

Notices

Superintelligence (SI) outputs can be wrong. Important decisions should include human review.

Bring us a workflow and its data.

Tell us the workflow, the sources it draws on and the decisions it supports, and we scope the agents, tools and tests around them.

Discuss a build