Red Queen Gödel Machine

The Red Queen Gödel Machine is a recursive self-improvement framework where the agent and evaluator co-evolve. The key lesson for Kevin's stack is that a frozen judge becomes a target; the evaluator must get harder as the agent improves.

Core Idea

Classic self-improvement loops assume a fixed benchmark, verifier, or labeled dataset remains valid as the agent improves. RQGM treats that as structurally wrong for open-ended domains: agents can overfit a static evaluator, find reward-hacking seams, or improve beyond what the judge can measure. Source: arXiv:2606.26294, 2026-06-24

The paper's answer is controlled utility evolution: search is organized into epochs with a fixed within-epoch criterion, but the utility/evaluator can update at epoch boundaries. This gives the loop a stable local target while still allowing the global judge to evolve. Source: arXiv:2606.26294

Why It Matters

RQGM upgrades The Eval Loop (Slop Is an Output Problem) from "write an eval" to "write an eval that is itself allowed to improve." That matters for:

• agent self-improvement,
• skill-quality benchmarks,
• bookmark-artifact review,
• code-review doctors,
• content/taste rubrics,
• product loops where the agent can learn the old judge.

The practical failure mode is a frozen rubric that agents learn to satisfy without getting better. The practical fix is to add evaluator hardening rules: failed runs become new cases, saturated cases split into finer checks, and high-scoring agents get harder held-out failures.

Local Translation

For Kevin's agents, RQGM becomes:

1. Keep a stable eval suite for the current epoch.
2. Score each substantial run with a receipt.
3. When the agent fails, add a regression case before editing the agent.
4. When the agent saturates the suite, add a harder held-out case or split a broad judge into BINEVAL-style atomic questions.
5. Version evaluator changes in the wiki and git, not chat memory.

The local implementation is Agent Self-Improvement Eval Library.

Concept Position

---

Timeline

• 2026-07-01 | Concepts category refresh added this page to the Agent harness and runtime primitives family, linked it to Concept System Map, and kept it standalone because it owns this reusable mental model: The Red Queen Gödel Machine is a recursive self-improvement framework where the agent and evaluator co-evolve. The key lesson for Kevin's s... Source: User request, 2026-07-01
• 2026-06-29 | Created from Omar Sar's bookmark and paper screenshot after Kevin asked to build a self-improvement eval library. Source: X/@omarsar0, 2026-06-28; arXiv:2606.26294