Skip to content
Back/Harness Engineering

Harness Engineering — Overview

View in Graph
Updated 2026-11-12
1 min read
232 words

Harness Engineering — Overview

Core Questions

  • 什么能力属于模型、什么属于 harness、什么属于可积累的 context substrate;harness 编码的对模型限制的假设何时该删(见 What is an Agent Harness)。
  • Agent 长时运行、并行协作、自我验证分别需要什么工程边界;什么信号说明长时程自主运行正在失败。
  • 哪些安全和观测机制必须从 prompt 下沉到系统层(见 Trust Boundaries)。

Key Concepts

  • Harness 是模型之外的完整执行壳层:Harness is Everything 记录同一模型不同 harness 性能差距可达 64%;Model-Harness-Fit 进一步主张 harness 已成为模型有效参数的一部分。
  • 脚手架会随模型进化而拆除:定义页拆分 记录多位实践者共识——harness 是临时基础设施,Manus 六个月重写五次每次都在删复杂度;但删到什么程度、何时重写没有可操作判据。
  • 循环与长时运行:Loop Engineering 拆分页覆盖循环谱系、意图债务/理解腐蚀风险与可量化目标循环;Long-Running Agent Harness 给出 planner/generator/evaluator 分离架构。
  • 验证与信任边界:Self-Verification Loops 拆分页确立『验证器必须与生成器分离』『单元通过不等于功能可用』;Trust Boundary 拆分页给出默认只读、scoped 凭证与支付授权边界。
  • 记忆与协调:Memory vs Context Substrate 拆分页指出两阵营二分是假象、真实系统全是混合体;Multi-Agent Coordination 拆分页提供并行成本冷数据(多智能体平均贵 1.8-5.1 倍而收益微弱)。

Main Tensions

  • Harness 即一切的杠杆证据 vs『harness 是临时脚手架应持续删减』:两者同时成立——固定模型切换 harness 移动分数超过一代模型升级,但旧 harness 假设(如 context anxiety)会成为死代码拖累新模型。
  • 多 agent 扩张的吸引力 vs 成本冷数据:协调成本膨胀与子 agent 数量阈值效应,和『五个 agent 各完成 70%』的全局节奏观形成真实权衡,判断线(何时值得、何时折回单循环)尚未沉淀。
  • 自动化的复利 vs 负复利:Compound Engineering 拆分页明确回写须有证据阈值与撤销路径,没有确认门的学习永久化会沉淀成规则债务。

Current Judgments

  • 以下为 AI 草稿判断,非个人背书:harness 设计对 agent 可靠性的杠杆作用独立于模型能力且有横评支撑(LangChain 仅改 harness 使排名从 30+ 升至第 5、模型不变);但各结论的具体倍数多为单一评测转述,量级不确定性高。
  • 记忆系统的选择层(记什么、何时更新、事实如何被替代)比存储选型更决定成败——此判断在拆分页中反复收敛,但产品对比多为文档级比较而非受控实测,属中等置信。
  • 评测正从公共基准转向组织账本(见 Evals as Ledger),评分器自身可被操纵(RL 预置原题、73 轮评分优化毁掉原目标),所以评分独立性必须显式设计。

To Read / To Verify

Output Directions

  • 写『模型是常量,Harness 是变量』的解释稿,串联 64% 差距数据、LangChain 排名案例与脚手架消亡论。
  • 产出一份『长时运行 harness 检查表』:状态层外置、运行预算、独立 evaluator、交接单、退出条件。
  • 以『多 agent 何时值得』为题写一篇决策文,用成本冷数据对抗 agent 数量崇拜。

子主题导航

原版与来源

审计前完整导航及原判断

相关主题入口

Sources

Synthesized from 71 sources
  • 2026-06-07-18-09Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-18-20-25Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-19-08-03Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-19-18-47Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-18Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-04 [AINews] Reve 2 and Ideogram 4 Layouts in ImagegenSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-15 React for Agents Astro Creator Brings Hooks to his Meta-Harness FlueSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-04 Build tools to build moreSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-04-30-16-59Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-04-30-17-15Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-02-09-34Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-05-18-12Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-07-15-28Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-09-00-23Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-13-08-50Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-14-08-44Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-15-20-26Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-28-23-08Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-13-22-56Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-14-18-29Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-18-20-25Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-19-08-03Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-19-18-47Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-20-08-33Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-23-02-15Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-24-08-34Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-25-18-34Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-25-23-01Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-26-23-36Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-09-17-22-03Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-13Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-18Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-19Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-25Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-05-22 New AI Infra unicorns Exa Modal TurboPufferSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-05-23 AINews Newsletter 汇总 — 2026-05-23Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-07 [AINews] not much happened todaySupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-15 React for Agents Astro Creator Brings Hooks to his Meta-Harness FlueSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-05-11 Elon doubled limitsSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-23 How I built thisSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-04-29 Compute Is the New CashSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-28 Everyone Gets an Agent. Almost No One Gets the ModelSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-23 The Healthcare Company That Built the AI Tool It Couldn't BuySupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-27 Benchmarks Don't Know Your JobSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-28 Our ChatGPT and OpenClaw Guides Just Got an OverhaulSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-05-02 Demis Hassabis - AGI 还缺什么 智能体到底行不行Supporting source listed by this page.Whole pagemediumabsorb log
  • GitHub CPO:AI 编程真正拼的不是模型,而是缓存、评测和工作流丨ClaudeSupporting source listed by this page.Whole pagemediumabsorb log
  • How to build your own agent harness???Supporting source listed by this page.Whole pagemediumabsorb log
  • Karpathy 访谈:10x 工程师已是常态,真正的 Agentic 工程师是 100xSupporting source listed by this page.Whole pagemediumabsorb log
  • Long-running Agents - Addy OsmaniSupporting source listed by this page.Whole pagemediumabsorb log
  • Loop-Engineering-Addy-OsmaniSupporting source listed by this page.Whole pagemediumabsorb log
  • Super-agent 设计探索:迈向更自主的 Agent 系统Supporting source listed by this page.Whole pagemediumabsorb log
  • TMA1 v2:让 Coding Agent Loop 真的转起来Supporting source listed by this page.Whole pagemediumabsorb log
  • The Self-Healing Agent HarnessSupporting source listed by this page.Whole pagemediumabsorb log
  • how-coderabbit-used-claude-to-build-an-agent-orcheSupporting source listed by this page.Whole pagemediumabsorb log
  • 万字干货:理解 Harness Engineering,看这一篇就够了Supporting source listed by this page.Whole pagemediumabsorb log
  • 小宇宙-EP107-Harness-Engineering-顶尖智能体工程师-Cole-MedinSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-15 至 2026-08-18 AI 节目专题索引Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-19 EP591.Matt Pocock:开发者如何用 AI 放大十倍产出,模型狂热时代的软件基本功Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-23 EP594.Fiona Fung:AI 时代工程师如何不掉队,代码不再稀缺后的团队重构Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-24 EP596.AI 智能体:当百万个代理开始替你谈判、花钱与协作Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-06-30 EP606.Codex 负责人:品味与判断力为何成为你最值钱的资产Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-02 EP612.Kent Beck:AI 时代,软件工程里“人的部分”为何比代码更难Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-04 EP616.Matt Pocock:用一份检查清单,终结 AI Agent 的“技能地狱”Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-07 EP618.OpenCode 创始人:AI 编程狂潮下,如何保持清醒并找到你的不对称优势Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-09 EP620.Modal CTO:你的 AI 应用不该跑在K8s 上,Agent 时代的云应该长什么样Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-17 EP631.深入理解 Context engineeringSupporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-20 EP638.Agent Loop 大辩论:Loop究竟是炒作还是真有用Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-07-23 EP642.Kun Chen:顶尖工程师如何把 AI Agent 用到极致Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-02 EP657.AWS 老兵:新的软件开发生命周期Supporting source listed by this page.Whole pagemediumabsorb log
  • 2026-08-11 EP669.如何构建自主、长时程 AI 智能体Supporting source listed by this page.Whole pagemediumabsorb log

Evolution

1 event
  1. absorbed

    Derived from source material

    This page is currently synthesized from 71 sources.

    Sources: /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-06-07-18-09.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-08-18-20-25.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-08-19-08-03.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-08-19-18-47.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Builders Digest/2026-08-18.md · /Users/jean/Documents/Obsidian Vault/raw/newsletters/AINews/2026-06-04 [AINews] Reve 2 and Ideogram 4 Layouts in Imagegen.md · /Users/jean/Documents/Obsidian Vault/raw/newsletters/AINews/2026-08-15 React for Agents Astro Creator Brings Hooks to his Meta-Harness Flue.md · /Users/jean/Documents/Obsidian Vault/raw/newsletters/Ben's Bites/2026-06-04 Build tools to build more.md · raw/briefing/AI Briefing/2026-04-30-16-59.md · raw/briefing/AI Briefing/2026-04-30-17-15.md · raw/briefing/AI Briefing/2026-06-02-09-34.md · raw/briefing/AI Briefing/2026-06-05-18-12.md · raw/briefing/AI Briefing/2026-06-07-15-28.md · raw/briefing/AI Briefing/2026-06-09-00-23.md · raw/briefing/AI Briefing/2026-06-13-08-50.md · raw/briefing/AI Briefing/2026-06-14-08-44.md · raw/briefing/AI Briefing/2026-06-15-20-26.md · raw/briefing/AI Briefing/2026-06-28-23-08.md · raw/briefing/AI Briefing/2026-08-13-22-56.md · raw/briefing/AI Briefing/2026-08-14-18-29.md · raw/briefing/AI Briefing/2026-08-18-20-25.md · raw/briefing/AI Briefing/2026-08-19-08-03.md · raw/briefing/AI Briefing/2026-08-19-18-47.md · raw/briefing/AI Briefing/2026-08-20-08-33.md · raw/briefing/AI Briefing/2026-08-23-02-15.md · raw/briefing/AI Briefing/2026-08-24-08-34.md · raw/briefing/AI Briefing/2026-08-25-18-34.md · raw/briefing/AI Briefing/2026-08-25-23-01.md · raw/briefing/AI Briefing/2026-08-26-23-36.md · raw/briefing/AI Briefing/2026-09-17-22-03.md · raw/briefing/AI Builders Digest/2026-08-13.md · raw/briefing/AI Builders Digest/2026-08-18.md · raw/briefing/AI Builders Digest/2026-08-19.md · raw/briefing/AI Builders Digest/2026-08-25.md · raw/newsletters/AINews/2026-05-22 New AI Infra unicorns Exa Modal TurboPuffer.md · raw/newsletters/AINews/2026-05-23 AINews Newsletter 汇总 — 2026-05-23.md · raw/newsletters/AINews/2026-06-07 [AINews] not much happened today.md · raw/newsletters/AINews/2026-08-15 React for Agents Astro Creator Brings Hooks to his Meta-Harness Flue.md · raw/newsletters/Ben's Bites/2026-05-11 Elon doubled limits.md · raw/newsletters/Ben's Bites/2026-08-23 How I built this.md · raw/newsletters/Every/2026-04-29 Compute Is the New Cash.md · raw/newsletters/Every/2026-06-28 Everyone Gets an Agent. Almost No One Gets the Model.md · raw/newsletters/Every/2026-08-23 The Healthcare Company That Built the AI Tool It Couldn't Buy.md · raw/newsletters/Every/2026-08-27 Benchmarks Don't Know Your Job.md · raw/newsletters/Every/2026-08-28 Our ChatGPT and OpenClaw Guides Just Got an Overhaul.md · raw/social-triage/2026-05-02 Demis Hassabis - AGI 还缺什么 智能体到底行不行.md · raw/to-learn/GitHub CPO:AI 编程真正拼的不是模型,而是缓存、评测和工作流丨Claude.md · raw/to-learn/How to build your own agent harness???.md · raw/to-learn/Karpathy 访谈:10x 工程师已是常态,真正的 Agentic 工程师是 100x.md · raw/to-learn/Long-running Agents - Addy Osmani.md · raw/to-learn/Loop-Engineering-Addy-Osmani.md · raw/to-learn/Super-agent 设计探索:迈向更自主的 Agent 系统.md · raw/to-learn/TMA1 v2:让 Coding Agent Loop 真的转起来.md · raw/to-learn/The Self-Healing Agent Harness.md · raw/to-learn/how-coderabbit-used-claude-to-build-an-agent-orche.md · raw/to-learn/万字干货:理解 Harness Engineering,看这一篇就够了.md · raw/to-learn/小宇宙-EP107-Harness-Engineering-顶尖智能体工程师-Cole-Medin.md · raw/to-learn/跨国串门儿计划/2026-06-15 至 2026-08-18 AI 节目专题索引.md · raw/to-learn/跨国串门儿计划/episodes/2026-06-19 EP591.Matt Pocock:开发者如何用 AI 放大十倍产出,模型狂热时代的软件基本功.md · raw/to-learn/跨国串门儿计划/episodes/2026-06-23 EP594.Fiona Fung:AI 时代工程师如何不掉队,代码不再稀缺后的团队重构.md · raw/to-learn/跨国串门儿计划/episodes/2026-06-24 EP596.AI 智能体:当百万个代理开始替你谈判、花钱与协作.md · raw/to-learn/跨国串门儿计划/episodes/2026-06-30 EP606.Codex 负责人:品味与判断力为何成为你最值钱的资产.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-02 EP612.Kent Beck:AI 时代,软件工程里“人的部分”为何比代码更难.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-04 EP616.Matt Pocock:用一份检查清单,终结 AI Agent 的“技能地狱”.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-07 EP618.OpenCode 创始人:AI 编程狂潮下,如何保持清醒并找到你的不对称优势.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-09 EP620.Modal CTO:你的 AI 应用不该跑在K8s 上,Agent 时代的云应该长什么样.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-17 EP631.深入理解 Context engineering.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-20 EP638.Agent Loop 大辩论:Loop究竟是炒作还是真有用.md · raw/to-learn/跨国串门儿计划/episodes/2026-07-23 EP642.Kun Chen:顶尖工程师如何把 AI Agent 用到极致.md · raw/to-learn/跨国串门儿计划/episodes/2026-08-02 EP657.AWS 老兵:新的软件开发生命周期.md · raw/to-learn/跨国串门儿计划/episodes/2026-08-11 EP669.如何构建自主、长时程 AI 智能体.md

Linked from