Skip to content
Back/Harness Engineering

自我验证循环

View in Graph
Updated 2026-11-12
1 min read
36 words

自我验证循环

页面堆叠了上百个日期化简报片段,核心张力——模型自报完成与真实端到端状态之间的系统性偏差——被淹没在按天追加的流水账里,验证手段(E2E、消融、receipt、独立 verifier)散落在互不引用的段落中。

主题导航

  • 单元测试通过不等于功能可用:多处来源一致指出 Agent 倾向于在缺少端到端证据时宣布完成,最小 E2E smoke test、视觉回看和已知错误输入的负向检查是把『绿色』变成可信信号的手段。具体哪些检查值得常驻仍取决于任务风险,没有统一配方。
  • 验证器必须与生成器分离:模型自评系统性偏正,独立 verifier sub-agent、新上下文审查和低实现 effort 加高验证 effort 的两层循环都被报告优于自我批评。各方案的成本与逃逸缺陷对比多为个人转述,缺少受控数据。
  • 验收标准与证据产物先于实现:独立的 Definition of Done、行为标准评测和可回放的证据包(trace、PR、CI、截图、录像)被反复提出,用来把『agent 说完成了』换成可检查产物。证据分级的粒度和人工审阅预算如何匹配仍是开放问题。

来源与原文

拆分前完整原文与来源

相关主题入口

Sources

Synthesized from 66 sources

Evolution

1 event
  1. absorbed

    Derived from source material

    This page is currently synthesized from 66 sources.

    Sources: /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-03-02-03.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-05-17-46.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-06-17-40.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-06-23-01.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-07-19-14.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-07-22-58.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-09-23-00.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-10-23-08.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-12-23-00.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-13-22-58.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-14-08-06.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-14-22-58.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-15-08-12.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-16-02-18.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-17-22-58.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-18-23-00.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-24-22-58.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-26-08-04.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-09-27-08-03.md · /Users/jean/Documents/Obsidian Vault/raw/briefing/AI Briefing/2026-10-01-08-03.md · /Users/jean/Documents/Obsidian Vault/raw/newsletters/Ben's Bites/2026-09-03 Build your ideas.md · /Users/jean/Documents/Obsidian Vault/raw/newsletters/Ben's Bites/2026-09-10 Everyone needs a Muse.md · /Users/jean/Documents/Obsidian Vault/raw/newsletters/Every/2026-09-13 What to Make of the Anthropic Warning.md · /Users/jean/Documents/Obsidian Vault/raw/social-triage/2026-09-19 Eero Alvar 用AI学习的系统.md · raw/briefing/AI Briefing/2026-06-07-18-09.md · raw/briefing/AI Briefing/2026-06-08-09-45.md · raw/briefing/AI Briefing/2026-08-28-17-43.md · raw/briefing/AI Briefing/2026-08-28-23-01.md · raw/briefing/AI Briefing/2026-08-30-23-07.md · raw/briefing/AI Briefing/2026-08-31-23-04.md · raw/briefing/AI Briefing/2026-09-02-00-34.md · raw/briefing/AI Briefing/2026-09-03-02-03.md · raw/briefing/AI Briefing/2026-09-05-17-46.md · raw/briefing/AI Briefing/2026-09-06-17-40.md · raw/briefing/AI Briefing/2026-09-06-23-01.md · raw/briefing/AI Briefing/2026-09-07-19-14.md · raw/briefing/AI Briefing/2026-09-07-22-58.md · raw/briefing/AI Briefing/2026-09-09-23-00.md · raw/briefing/AI Briefing/2026-09-10-23-08.md · raw/briefing/AI Briefing/2026-09-12-23-00.md · raw/briefing/AI Briefing/2026-09-13-22-58.md · raw/briefing/AI Briefing/2026-09-14-08-06.md · raw/briefing/AI Briefing/2026-09-14-22-58.md · raw/briefing/AI Briefing/2026-09-15-08-12.md · raw/briefing/AI Briefing/2026-09-16-02-18.md · raw/briefing/AI Briefing/2026-09-17-22-58.md · raw/briefing/AI Briefing/2026-09-18-23-00.md · raw/briefing/AI Briefing/2026-09-24-22-58.md · raw/briefing/AI Briefing/2026-09-26-08-04.md · raw/briefing/AI Briefing/2026-09-27-08-03.md · raw/briefing/AI Briefing/2026-10-01-08-03.md · raw/briefing/AI Briefing/2026-10-13-23-02.md · raw/briefing/AI Briefing/2026-10-27-22-56.md · raw/briefing/AI Briefing/2026-11-01-08-02.md · raw/briefing/AI Briefing/2026-11-02-23-00.md · raw/briefing/AI Briefing/2026-11-03-23-00.md · raw/briefing/AI Briefing/2026-11-06-23-30.md · raw/newsletters/Ben's Bites/2026-09-03 Build your ideas.md · raw/newsletters/Ben's Bites/2026-09-10 Everyone needs a Muse.md · raw/newsletters/Every/2026-09-13 What to Make of the Anthropic Warning.md · raw/newsletters/Every/2026-09-17 Mini-Vibe Check TypeSafe Jev Judged Everything I’ve Written in 0.7 Seconds.md · raw/to-learn/2026-11-02-youtube-PcO998TSzIs-lauren-tan-grokbot-team.md · raw/to-learn/Agent 自我改进的六条路.md · raw/to-learn/Continual learning for AI agents.md · raw/to-learn/Designing loops with Fable 5.md · raw/to-learn/Long-running Agents - Addy Osmani.md

Linked from