References and Further Reading
Every factual claim in the course links its source inline. This page collects those links by lesson. Sources were checked against the primary document when cited (September 2026). The few claims known only from secondary coverage are tagged secondary, and the lessons present them as "reported". Products and benchmarks in this field change monthly: when a source and a lesson disagree, trust the source's current version and tell us.
Start here
If you read nothing else, read these. They are the documents that defined harness engineering as a discipline, in rough chronological order.
- Anthropic — Effective harnesses for long-running agents · Nov 2025
- OpenAI — Harness engineering: leveraging Codex in an agent-first world · Feb 2026
- Anthropic — Harness design for long-running application development · Mar 2026
- Birgitta Böckeler — Harness engineering for coding agent users · Apr 2026
- Anthropic — Scaling Managed Agents: decoupling the brain from the hands · Apr 2026
- Anthropic — April 23 Claude Code quality postmortem · Apr 2026
- Lilian Weng — Harness Engineering for Self-Improvement · Jul 2026
- DeepSeek Harness (dsh) — repository and architecture docs · Aug 2026
- Manus — Context engineering for AI agents: lessons from building Manus · Jul 2025
- Simon Willison — The lethal trifecta for AI agents · Jun 2025
- Stop Comparing LLM Agents Without Disclosing the Harness (position paper) · May 2026
- Ryan Lopopolo — harness engineering anthology · Jul 2026
By lesson
1. What Is Harness Engineering?
- LangChain, 2026
langchain.com
2. Anatomy of a Harness
- lilianweng.github.io — 2026 07 04 harness
lilianweng.github.io
3. The Model Layer: Commodity Intelligence, Capability Overhang, and Co-Design
- Databricks (2026)
databricks.com - Hugging Face, April 2026
huggingface.co - DeepSeek, August 2026
api-docs.deepseek.com - April 2026 Claude Code postmortem
anthropic.com
4. The Agent Loop: Steps, Turns, and Stopping
- OpenAI, 2026
openai.com - OpenAI Agents SDK docs
openai.github.io - DeepSeek Harness, architecture.md (2026)
github.com - DeepSeek Harness, agent-lifecycle.md (2026)
github.com - OpenAI, 2026
openai.com - Claude Agent SDK docs
code.claude.com - DeepSeek Harness, core subsystem docs (2026)
github.com - LangChain, 2026
langchain.com - DeepSeek Harness, repeat-tool-reminder (2026)
github.com - DeepSeek Harness, tools subsystem docs (2026)
github.com - manus.im — Context Engineering for AI Agents Lessons from Building Manus
manus.im - guard package README
github.com - Anthropic, Claude API docs
platform.claude.com - Hugging Face, DeepSeek-V4 (2026)
huggingface.co - Anthropic, 2026
anthropic.com - dsh tool-execution-pipeline.md
github.com - Anthropic, 2026
anthropic.com
5. Context Engineering: What the Model Sees
- Databricks (2026)
databricks.com - Chroma (2025)
trychroma.com - Agentic Context Engineering (ACE; Zhang et al., 2025)
arxiv.org - Meta Context Engineering (MCE; Ye et al., 2026)
arxiv.org - lilianweng.github.io — 2026 07 04 harness
lilianweng.github.io - Anthropic (2025)
anthropic.com - Anthropic's Skills post (2025)
anthropic.com - Manus (Ji, 2025)
manus.im
6. Context Lifecycle: Compaction, Caching, and the Event Log
- DeepSeek Harness's architecture docs (2026)
github.com - Scaling Managed Agents (2026)
anthropic.com - wire extensions reference (2026)
github.com - Unrolling the Codex agent loop (2026)
openai.com - prompt caching docs
platform.claude.com - Context Engineering for AI Agents (2025)
manus.im - MCP 2026-07-28 changelog
modelcontextprotocol.io - April 23 postmortem (2026)
anthropic.com - agent lifecycle docs (2026)
github.com - compaction subsystem reference
github.com - spill package
github.com - Effective harnesses for long-running agents (2025)
anthropic.com - Harness design for long-running application development (2026)
anthropic.com
8. Memory: Session, Agent, and Organizational Tiers
- agents.md
agents.md - its documentation
code.claude.com - "Harness engineering" (OpenAI, 2026)
openai.com
9. Specs and the Repo as System of Record
- "Harness engineering: leveraging Codex in an agent-first world" (OpenAI, 2026)
openai.com - agents.md
agents.md - Böckeler (2026)
martinfowler.com
10. Prompting at the Frontier: The Inversion
- Anthropic's April 23 postmortem (2026)
anthropic.com - "Harness design for long-running application development" (Anthropic, 2026)
anthropic.com
11. Tools, MCP, Skills, and Action Surfaces
- modelcontextprotocol.io
modelcontextprotocol.io - 2026-07-28 specification (2026)
modelcontextprotocol.io - Invariant Labs (2025)
invariantlabs.ai - Agent Skills specification site (2026)
agentskills.io - Cloudflare's Code Mode (2025)
blog.cloudflare.com - Anthropic's programmatic tool calling (2026)
platform.claude.com - DeepSeek Harness's ptc-runtime (2026)
github.com
12. Execution Environments and Sandboxing
- Anthropic, 2025
anthropic.com - docs.kernel.org — landlock.html
docs.kernel.org - gvisor.dev — docs
gvisor.dev - firecracker-microvm.github.io
firecracker-microvm.github.io - openai/codex, 2026
github.com - DeepSeek Harness, 2026
github.com - DeepSeek Harness sandbox subsystem, 2026
github.com - Anthropic, 2026
anthropic.com - Cloudflare, 2025
blog.cloudflare.com - DeepSeek Harness architecture, 2026
github.com - DeepSeek Harness capability seams, 2026
github.com - DeepSeek Harness PTC runtime, 2026
github.com - DeepSeek via Hugging Face, 2026
huggingface.co - Terminal-Bench, 2026
tbench.ai - Anthropic, 2026
anthropic.com - Anthropic, 2025
anthropic.com - Anthropic, 2025
anthropic.com - DeepSeek Harness, 2026
github.com
13. Guardrails, Permissions, and Governance
- Anthropic, 2026
anthropic.com - Databricks, 2026
databricks.com
14. Agent Security: Prompt Injection and the Lethal Trifecta
- Greshake et al. (2023)
arxiv.org - Nasr, Carlini, Sitawarin et al. (2025)
arxiv.org - Willison (2025)
simonwillison.net - Invariant Labs, 2025
invariantlabs.ai - Pillar Security, 2025
pillar.security - Invariant Labs, 2025
invariantlabs.ai - Agents Rule of Two (October 2025)
ai.meta.com - Willison (2025)
simonwillison.net - Managed Agents write-up (2026)
anthropic.com - Dual LLM pattern (2023)
simonwillison.net - Beurer-Kellner et al. (2025)
arxiv.org - CaMeL (Debenedetti et al., 2025)
arxiv.org - Claude Code auto mode (March 2026)
anthropic.com - Snyk's coveragesecondary
snyk.io - Nx security advisory
github.com - Snyk's analysissecondary
snyk.io - September 2025 alert
cisa.gov - AgentPoison (Chen et al., 2024)
arxiv.org - Roesner and Kohno (September 2026)
arxiv.org - github.com — SAFETY.md
github.com - wire-extensions reference
github.com - session-log package README
github.com
15. Long-Running Agents and Loop Engineering
- METR, 2025; updated 2026
metr.org - "Effective harnesses for long-running agents" (Nov 2025)
anthropic.com - "Harness design for long-running application development" (Mar 2026)
anthropic.com - "Loop engineering: getting started with loops" (Jun 2026)
claude.com - Ralph technique (Jul 2025)
ghuntley.com - DeepSeek Harness (dsh)
github.com - packages/goal
github.com - packages/workflow/tool-ralph
github.com - packages/schedule
github.com - packages/jobs
github.com - packages/guard
github.com - "Harness engineering: leveraging Codex in an agent-first world" (Feb 2026)
openai.com - Lavaee, 2026secondary
alexlavaee.me
16. Multi-Agent Orchestration Patterns
- lilianweng.github.io — 2026 07 04 harness
lilianweng.github.io - "Building a C compiler with a team of parallel Claudes" (2026)
anthropic.com - DeepSeek, 2026
github.com - DeepSeek, 2026
github.com - v1.0 (March 2026)
a2a-protocol.org - joined the Agentic AI Foundation (2026)
a2a-protocol.org
17. Observability Is Not Evals
- State of Agent Engineering report (2026)
langchain.com - Meta-Harness (Lee et al., 2026)
arxiv.org - arxiv.org — 2603.28052
arxiv.org - Agentic Harness Engineering (AHE; Lin et al., 2026)
arxiv.org - layered reports
github.com - Managed Agents (2026)
anthropic.com - architecture docs (2026)
github.com - MCP 2026-07-28 specification
modelcontextprotocol.io - GenAI agent span conventions
github.com
18. Building Eval Harnesses
- Databricks (2026)
databricks.com - stopped reporting SWE-bench Verified (2026)
openai.com - Terminal-Bench 2.1
tbench.ai - measured infrastructure noise (2026)
anthropic.com - Needham et al. (2025)
arxiv.org - anti-scheming study (Schoen et al., 2025)
arxiv.org
19. Benchmarking Harnesses: Disclosure, Noise, and Harness Swaps
- LangChain (Feb 2026)
langchain.com - Agentic Harness Engineering (Lin et al., 2026)
arxiv.org - project README
github.com - Meta-Harness (Lee et al., 2026)
arxiv.org - Databricks (2026)
databricks.com - V4-Pro general-availability post (Aug 2026)
api-docs.deepseek.com - FindHarness's coveragesecondary
findharness.com - "Stop Comparing LLM Agents Without Disclosing the Harness" (Zhang et al., 2026)
arxiv.org - Anthropic (Feb 2026)
anthropic.com - Terminal-Bench 2.1
tbench.ai - "Why we no longer evaluate SWE-bench Verified" (2026)
openai.com - SWE-bench Pro (Deng et al., 2025)
arxiv.org - tbench.ai — terminus
tbench.ai - vals.ai — terminal bench 2 1
vals.ai - Artificial Analysis
artificialanalysis.ai - docs.harborframework.com — run a job.md
docs.harborframework.com - Anthropic's (Mar 2026)
anthropic.com - Weinberger & Hozez (2026)
arxiv.org - τ-bench (Yao et al., 2024)
arxiv.org
20. Review Architecture and the Self-Review Trap
21. The Improvement Loop: Autoresearch for Harnesses
- Self-Taught Optimizer (STOP; Zelikman et al., 2023)
arxiv.org - Self-Harness (Zhang et al., 2026)
arxiv.org - Bubeck et al. (2025)
arxiv.org - lilianweng.github.io — 2026 07 04 harness
lilianweng.github.io - postmortem on Claude Code quality reports (2026)
anthropic.com
22. Self-Improving Harnesses: Search, Evolution, and RSI
- I. J. Good (1965)
philpapers.org - Yudkowsky (2008)
lesswrong.com - lilianweng.github.io — 2026 07 04 harness
lilianweng.github.io - ADAS (Hu et al., 2025)
arxiv.org - AFlow (Zhang et al., 2025)
arxiv.org - AI Scientist (Lu et al., 2026)
nature.com - ScientistOne (Meng et al., 2026)
arxiv.org - Promptbreeder
arxiv.org - arxiv.org — 2507.19457
arxiv.org - AlphaEvolve (Novikov et al., 2025)
arxiv.org - ShinkaEvolve (Lange et al., 2025)
arxiv.org - Darwin Gödel Machine (DGM; Zhang et al., 2025)
arxiv.org - Hyperagents (Zhang et al., 2026)
arxiv.org - arxiv.org — 2510.04618
arxiv.org - arxiv.org — 2601.21557
arxiv.org - Meta-Harness (Lee et al., 2026)
arxiv.org - STOP (Zelikman et al., 2023)
arxiv.org - Self-Harness (Zhang et al., 2026)
arxiv.org - SIA (Hebbar et al., 2026)
arxiv.org - Lin et al. (2026)
arxiv.org - github.com — autoagent
github.com - MarkTechPost (2026)secondary
marktechpost.com - Sengupta & Wang (2026)
arxiv.org - Lee, Xu, Seely, Lee, Zaharia & Tang (2026)
arxiv.org - Zhang et al. (2026)
arxiv.org - Kim et al. (2026)
arxiv.org - Agent Debugger
github.com - Trehan & Chopra (2026)
arxiv.org - Bubeck et al., 2025
arxiv.org - arxiv.org — 2504.01848
arxiv.org - arxiv.org — 2409.11363
arxiv.org - ScienceAgentBench
arxiv.org - arxiv.org — 2411.15114
arxiv.org - arxiv.org — 2410.07095
arxiv.org - arxiv.org — 2502.10517
arxiv.org
23. Teardown: DeepSeek Harness
- github.com/deepseek-ai/deepseek-harness (2026)
github.com - V4-Flash-Vision-Exp announcement (2026)
api-docs.deepseek.com - github.com — cordis
github.com - A Programming Paradigm for Spatiotemporal Composability (2026)
arxiv.org - docs/architecture.md (2026)
github.com - packages/README.md (2026)
github.com - lifecycle sequence (2026)
github.com - Anthropic's Managed Agents write-up (2026)
anthropic.com - wire-extension reference (2026)
github.com - Manus context-engineering post (2025)
manus.im - MCP 2026-07-28 specification (2026)
modelcontextprotocol.io - compaction group README (2026)
github.com - spill group README (2026)
github.com - Hugging Face DeepSeek-V4 blog (April 2026)
huggingface.co - April V4 preview (2026)
api-docs.deepseek.com - August GA announcement (2026)
api-docs.deepseek.com - FindHarness's write-up (2026)secondary
findharness.com - SAFETY.md notice (2026)
github.com - session-log-deepseek README (2026)
github.com
24. Teardown: Claude Code, Codex, and the Open Harnesses
- code.claude.com — how claude code works
code.claude.com - SDK overview
code.claude.com - Anthropic, Apr 2026
anthropic.com - OpenAI, Jan 2026
openai.com - OpenAI, Feb 2026
openai.com - code.claude.com — memory
code.claude.com - AGENTS.md docs
learn.chatgpt.com - code.claude.com — hooks
code.claude.com - code.claude.com — skills
code.claude.com - learn.chatgpt.com — hooks
learn.chatgpt.com - learn.chatgpt.com — build skills
learn.chatgpt.com - code.claude.com — permission modes
code.claude.com - Anthropic, Mar 2026
anthropic.com - code.claude.com — sandboxing
code.claude.com - sandbox docs
learn.chatgpt.com - learn.chatgpt.com — auto review
learn.chatgpt.com - code.claude.com — sub agents
code.claude.com - learn.chatgpt.com — subagents
learn.chatgpt.com - learn.chatgpt.com — codex sdk
learn.chatgpt.com - code.claude.com — data usage
code.claude.com - advanced config
learn.chatgpt.com - github.com — claude code
github.com - github.com — codex
github.com - opencode.ai — server
opencode.ai - how Pi works
github.com - github.com — software agent sdk
github.com - opencode.ai — config
opencode.ai - github.com — compaction.md
github.com - docs.openhands.dev — context condenser
docs.openhands.dev - opencode.ai — rules
opencode.ai - github.com — security.md
github.com - docs.openhands.dev — skills
docs.openhands.dev - opencode.ai — plugins
opencode.ai - opencode.ai — skills
opencode.ai - opencode.ai — permissions
opencode.ai - docs.openhands.dev — security
docs.openhands.dev - github.com — opencode
github.com - opencode.ai — acp
opencode.ai - github.com — OpenHands
github.com - github.com — pi
github.com - github.com — qwen code
github.com - github.com — kimi code
github.com - github.com — deepagents
github.com - docs.langchain.com — overview
docs.langchain.com - qwenlm.github.io — settings
qwenlm.github.io - moonshotai.github.io — config files
moonshotai.github.io - approval modes
qwenlm.github.io - moonshotai.github.io — interaction
moonshotai.github.io - MCP changelog
modelcontextprotocol.io - agents.md
agents.md - OpenAI, Feb 2026
openai.com - agentskills.io
agentskills.io - agentclientprotocol.com — introduction
agentclientprotocol.com - OpenAI Developers
developers.openai.com - extension docs
github.com - Anthropic, Apr 2026
anthropic.com - Anthropic, Mar 2026
anthropic.com
25. Pilot to Production: The Forward-Deployed Craft
- Mayfield survey of 266 enterprise technology executives (2026)
mayfield.com - Claw-SWE-Bench (2026)
arxiv.org - April 2026 Claude Code postmortem
anthropic.com
26. Agent Economics: Pricing, Tokens, Caching, and Pods
- Databricks (2026)
databricks.com - "Prompt-Induced Waste in Coding Agents" (2026)
arxiv.org - manus.im — Context Engineering for AI Agents Lessons from Building Manus
manus.im - MCP 2026-07-28 revision
modelcontextprotocol.io - Claw-SWE-Bench (2026)
arxiv.org - 36Kr's coverage (2026)secondary
eu.36kr.com - DeepSeek, 2026
api-docs.deepseek.com - April 2026 Claude Code postmortem
anthropic.com