Back to feed
News Story
meng shao (X)
1 sources

EverMind open-sources multi-agent Host Agent framework Raven, positioned as "the harness of harnesses"

EverMind has open-sourced Raven, a multi-agent Host Agent framework that orchestrates coding agents like Claude Code and Codex by decomposing tasks into DAGs and dispatching specialized built-in and third-party agents. Raven includes four built-in agents—Research, Code, Design, and Oncall—and supports recursive self-improvement (RSI) through Evolver, along with EverOS Memory, SkillForge, and Proactivity modules. Official showcases include the fully autonomous THRESHOLD game development project and RSI experiments, with release materials also generated by Raven itself.

SynthePulse Insight · AI deep reading

Raven Wants to Be the "Harness of Harnesses": One Orchestration Layer, and a Pile of Unverified Numbers

Version 1 · 1 source

EverMind has open-sourced Raven, a multi-agent host framework that breaks tasks into DAGs, schedules built-in and third-party agents, and claims it can make harnesses improve themselves. But every performance number comes from the official README or a single relay post, with no third-party reproduction—which means it currently reads more like an architecture proposal worth studying than an evaluation report you can trust.

  • Raven is a multi-agent Host Agent framework open-sourced by EverMind, positioning itself as "the harness of harnesses," sitting above coding agents like Claude Code and Codex to orchestrate them rather than replace them.
  • Its working method is to break complex tasks into a task DAG, specify dependencies, parallelize what can be parallelized, and then dispatch each node to the most suitable agent.
  • Its integration surface is broad: four built-in specialized agents, plus third-party agents via ACP, CLI, or OpenAI-compatible APIs, with 13 official presets.
  • The RSI narrative lands on Evolver: the main loop is split into four decoupled strategy modules—Memory, Planning, Capability, Action—and an experimental Curator rewrites the actual code of these four blocks.
  • All performance and comparison data—DataAgentBench 0.8762 Pass@1, AI4AI/AI4S outperforming Claude Code, the RSI experiment's 5.8% val_bpb reduction—has no third-party independent verification and can only be treated as source claims.
  • The real differentiator worth watching is the unattended long-horizon workflows Raven-Oncall targets, not yet another interactive coding tool.
Open section navigationWhat It's Trying to Solve Isn't "Writing Code," but "Who Orchestrates"

What It's Trying to Solve Isn't "Writing Code," but "Who Orchestrates"

Raven's entry point is explicitly framed as a gap: the current agent ecosystem is fragmented, Claude Code and Codex each have their strengths, but there's no unified layer to orchestrate them. Raven defines itself as a "host agent" that receives complex tasks, generates a task DAG, specifies dependencies, lets parallelizable parts run in parallel, and then dispatches each node to the most suitable agent.

This positioning determines that its relationship with coding agents is additive rather than competitive: it sits above Claude Code and Codex, connecting to third-party agents via ACP, CLI, or OpenAI-compatible APIs, with 13 official presets including Claude Code, Codex, Qwen Code, and Kimi Code. In other words, Raven's value proposition isn't that any single capability is stronger, but that it organizes existing harnesses into a team.

What needs to be distinguished: the framework being open-source and positioned as "the harness of harnesses" are confirmed facts; while the judgment that "the ecosystem is fragmented and lacks a unified orchestration layer" comes from the source's narrative and is a source claim.

Four Built-in Agents: Clear Responsibility Boundaries, but Scores Only from the Official Line

Raven has four built-in specialized agents, each with clear responsibility boundaries and corresponding benchmarks: Raven-Research handles autonomous deep research, literature reviews, and structured reports with traceable citations; Raven-Code targets agentic software development; Raven-Design produces visual deliverables like PPTs, posters, charts, and web interfaces; Raven-Oncall targets unattended long-horizon workflow automation.

On the numbers, the README claims Raven-Code tops DataAgentBench with 0.8762 Pass@1; the official line also claims Raven-Oncall outperforms Claude Code on AI4AI and AI4S benchmarks across quality, success rate, and cost. Both of these are official claims only, with specific test conditions and values undisclosed, and no third-party reproduction.

So the more prudent reading is: these scores show the team has offered a testable target, not that Raven has already won on these dimensions.

Raven-Oncall Is Where the Real Differentiation Lies

Among the four built-in agents, Raven-Oncall's scenario is the least like "yet another coding assistant": it targets unattended long-horizon workflow automation, capable of running multi-hour experiments, overnight monitoring, and continuous optimization. The source treats this as the key distinction between Raven and interactive coding tools.

This distinction has practical significance. The value of interactive tools is realized between human turns, while the value of Oncall-type scenarios lies in whether the system can keep advancing, keep verifying, and keep converging after the human leaves. Raven's DAG scheduling, memory, and skill retrieval modules only get truly stress-tested in long-horizon tasks.

But note the boundary: the source only describes the scenario and positioning, without explaining the degree of human intervention in such long-horizon tasks, nor providing comparable stability data.

How RSI Lands: The Gatekeeping Design of Evolver and Curator

Recursive self-improvement is the most radical part of the Raven narrative, landing on Evolver: it splits the agent main loop into four decoupled strategy modules—Memory (what context is seen this round), Planning (what method to use), Capability (which tools are available each round), Action (what to do next and judgment before execution).

An experimental Curator rewrites the actual code of these four blocks, not just prompts, but also tools, skills, and judgment logic. The key is the constraint: candidate changes must first beat the baseline on a benchmark and pass a validation gate before being installed, and feedback strips out reference answers to prevent "cheating." On first use, Curator also assembles a customized Persona team based on the user's task description, consisting of a lead role plus several expert agents.

This gatekeeping design is the most worthy part of the entire material to take seriously, because it turns "self-improvement" from a slogan into a process with admission conditions. But the degree of autonomy and safety boundaries of Curator rewriting code are not detailed by the source.

Three Foundations Supporting Long Horizons: Memory, Skills, and Proactivity

EverOS Memory provides three layers of cross-session memory: user context, the agent's own experience, and world knowledge. SkillForge unifies retrieval across local skill libraries, memory, and roughly 114,000 Skills on SkillHub. Proactivity provides event listening and scheduled dispatch for reminders and follow-ups.

Together these three explain a question: why Raven dares to stretch tasks to hours or even overnight. Without cross-session memory, long-horizon tasks would have to rebuild context every round; without unified skill retrieval, agents can't reuse existing capabilities; without event and scheduling mechanisms, unattended operation is out of the question.

It should be noted that the 114,000 figure comes from the source's description and has not been independently verified.

Two Showcases: One Demonstrating Long Horizons, One Demonstrating Self-Improvement

The THRESHOLD project is used to demonstrate long-horizon multi-agent collaboration: about 4 days, 42 rounds of planning/development/validation cycles, fully autonomously producing a Godot 4 FPS game, plus posters, a presentation, and a website.

The RSI experiment is used to demonstrate self-improvement: 7 rounds totaling 172 nanochat training runs with no crashes throughout, reducing val_bpb by 5.8% under a fixed 20-minute single-GPU budget. The source also mentions CFD (dam-break problem overshoot reduced by three orders of magnitude) and FEA ultimate load search optimization cases.

There's also a "self-proving" detail: the release materials—a browser physics mini-game, a 16-page deck, the README itself—were all generated by Raven itself. These showcases are compelling, but all lack one key piece of information: output quality and degree of human intervention. After 4 days and 42 rounds, how much did humans change, and what were the acceptance criteria? The source doesn't say; whether the 5.8% val_bpb improvement generalizes to other tasks is equally unknown.

How Much to Discount When Reading This Material

Look at the evidence in layers: the framework being open-source, its positioning, DAG scheduling, the four built-in agents, the Evolver and Curator gatekeeping mechanism, third-party integration methods—these are the source's descriptions of its own system, relatively credible but still source claims; while DataAgentBench 0.8762 Pass@1 topping the list, AI4AI/AI4S outperforming Claude Code on three metrics, the RSI experiment's 5.8% val_bpb reduction, and THRESHOLD's 4 days and 42 rounds all come from the official README or a single relay post, with no third-party independent verification.

There's also a weaker piece of evidence: a relay claims Raven builds a DAG from prompts, assigns each node to coding agents like Claude or Codex, collects outputs and feeds them back to the scheduler, allowing the DAG to automatically prune or expand. This description aligns with the official narrative's direction, but it's secondhand relay and can only be treated as a source claim.

Additionally, Raven 0.2.0's version status and subsequent roadmap are not clear in the source. Overall, what's worth watching about Raven is its orchestration abstraction and Curator gatekeeping design, not the numbers it reports about itself.

Credibility boundary

All facts in this article come from a single source: an X post about EverMind open-sourcing Raven and its relays. The framework being open-source and positioned as "the harness of harnesses" are confirmed facts; DAG scheduling, the four built-in agents, 13 third-party presets, the Evolver/Curator mechanism, three-layer memory and SkillForge, THRESHOLD and the RSI experiment are all source claims. All performance and comparison data—DataAgentBench 0.8762 Pass@1, AI4AI/AI4S outperforming Claude Code, 5.8% val_bpb reduction—have no third-party independent verification, with specific test conditions and values undisclosed. The judgment that "evidence comes only from official sources or a single relay" is this article's inference.

Insight takeaway

The questions Raven raises are more valuable than the answers it gives: when there are already enough coding agents, what's missing is an orchestration layer that can decompose dependencies, dispatch nodes, and continuously verify over long horizons. Its Curator gatekeeping design—candidate changes must first beat the baseline, with reference answers stripped to prevent cheating—is the most testable part of this material. As for those pretty numbers, until third-party reproduction appears, they're just the official line.

Primary report

meng shao (X)

Primary source