garrytan c02efeb57f D1: score overlay wrong answers as comparison results (contract v4) ...

A completed answer that fails the fixture's output check is now a valid
measurement with taskCorrect false and answerError set, in either arm.
Only execution, scope and metric failures invalidate a trial. ON
correctness still gates the case, so an OFF wrong answer stays in the
comparison. OVERLAY_CONTRACT moves to v4; v3 verdicts are not
reinterpreted. Replays the 37198445662 sonnet trials (OFF-0 wrong).

2026-10-04 17:21:59 +00:00

..

designs

docs: approved reliability follow-ups plan (Oct 2026)

2026-10-04 17:14:56 +00:00

evals

v1.6.4.0: cut Haiku classifier FP from 44% to 23%, gate now enforced (#1135)

2026-04-23 10:23:40 -07:00

images

feat: Completeness Principle — Boil the Lake (v0.6.1) (#140)

2026-03-17 16:34:08 -05:00

spikes

v1.61.0.0 fix wave: guards failing open / silent failures (9 fixes, 4 community PRs absorbed) (#2472)

2026-08-08 09:28:45 -07:00

ADDING_A_HOST.md

v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014)

2026-10-03 07:54:09 -07:00

askuserquestion-cjk.md

v1.56.0.0 Token-reduction Phase B + AUQ paranoid safety net (#1849)

2026-06-04 11:14:43 -07:00

askuserquestion-split.md

v1.87.6.0 fix: make checks reliable and everyday validation faster (#2898)

2026-09-22 14:57:52 -04:00

autoplan-guard-troubleshooting.md

v1.91.13.0 fix: severe bug wave (autoplan guard, land-and-deploy CI gate, project identity, gbrain, review gates) (#3013)

2026-10-02 11:11:00 -07:00

BROWSER_INTERNALS.md

v1.91.8.0 test: smaller suite, derived paid selection, retired never-green evals (#2994)

2026-09-29 08:58:49 -07:00

CHANGELOG_STYLE.md

v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014)

2026-10-03 07:54:09 -07:00

CONTRIBUTOR_REFERENCE.md

v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014)

2026-10-03 07:54:09 -07:00

cso-release-qualification.md

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

cso-scanners.md

v1.87.0.0 feat: add verified CSO audits and replayable repair bundles (#2852)

2026-09-14 15:14:58 -07:00

domain-skills.md

v1.81.0.0 feat: Aside is the browser gstack drives first; every browsing skill, the PDF/diagram renderer, and web research; the bundled browser stays the automatic fallback (#2810)

2026-09-06 08:54:25 -07:00

explanation-diataxis-in-gstack.md

v1.91.7.0 feat: add functional QA and pre-publication docs checks (#2983)

2026-09-29 06:07:35 -07:00

gbrain-sync-errors.md

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

gbrain-sync.md

v1.68.0.0 fix: next tracker wave — 16 verified fixes in, 90 stale PRs and 21 issues closed with receipts (#2632)

2026-08-19 11:42:55 -07:00

gbrain-write-surfaces.md

v1.91.13.0 fix: severe bug wave (autoplan guard, land-and-deploy CI gate, project identity, gbrain, review gates) (#3013)

2026-10-02 11:11:00 -07:00

howto-diagrams-and-formats.md

v1.81.0.0 feat: Aside is the browser gstack drives first; every browsing skill, the PDF/diagram renderer, and web research; the bundled browser stays the automatic fallback (#2810)

2026-09-06 08:54:25 -07:00

howto-document-a-shipped-feature.md

v1.91.7.0 feat: add functional QA and pre-publication docs checks (#2983)

2026-09-29 06:07:35 -07:00

howto-ios-testing-with-gstack.md

v1.67.1.0 fix: external-contributor security sweep — 6 findings hardened, regression-pinned (#2605)

2026-08-17 07:50:37 -07:00

memorable-workflow-memory.md

v1.83.0.0 feat: Memorable recall bridge, opt-in and receipted (supersedes #2831) (#2836)

2026-09-08 22:05:41 -07:00

ON_THE_LOC_CONTROVERSY.md

feat: gstack v1 — simpler prompts + real LOC receipts (v1.0.0.0) (#1039)

2026-04-18 15:05:42 +08:00

OPENCLAW_PUBLISHING.md

v1.71.0.0 feat: token-load reduction — preamble runtime scripts, gated onboarding, 20 skill carves, CLAUDE.md trim (#2691)

2026-08-27 09:50:31 -07:00

OPENCLAW.md

v1.91.7.0 feat: add functional QA and pre-publication docs checks (#2983)

2026-09-29 06:07:35 -07:00

OVERLAY_BENCHMARK_CONTRACT.md

D1: score overlay wrong answers as comparison results (contract v4)

2026-10-04 17:21:59 +00:00

PROJECT_STRUCTURE.md

v1.91.11.0 refactor: one state-root rule, browse route table, shared shard engine, PTY harness split, MECE review resolvers (#3002)

2026-10-01 11:57:48 -07:00

reference-qa-deadlines.md

v1.91.7.0 feat: add functional QA and pre-publication docs checks (#2983)

2026-09-29 06:07:35 -07:00

REMOTE_BROWSER_ACCESS.md

v1.81.0.0 feat: Aside is the browser gstack drives first; every browsing skill, the PDF/diagram renderer, and web research; the bundled browser stays the automatic fallback (#2810)

2026-09-06 08:54:25 -07:00

skills.md

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

SLOP_SCAN.md

v1.81.0.0 feat: Aside is the browser gstack drives first; every browsing skill, the PDF/diagram renderer, and web research; the bundled browser stays the automatic fallback (#2810)

2026-09-06 08:54:25 -07:00

state-root.md

v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014)

2026-10-03 07:54:09 -07:00

TEST_PORTFOLIO.md

v1.91.8.0 test: smaller suite, derived paid selection, retired never-green evals (#2994)

2026-09-29 08:58:49 -07:00

test-audit-2026-09.md

v1.91.8.0 test: smaller suite, derived paid selection, retired never-green evals (#2994)

2026-09-29 08:58:49 -07:00

test-value-bar.md

v1.91.9.0 feat: test value bar in plan-eng-review, review, qa and ship, plus /test-audit (#2998)

2026-09-29 14:35:00 -07:00

TESTING_INTERNALS.md

v1.91.18.0 feat: Opus 5.5 cleanup follow-ups — scoped transcript consent, opt-in Claude overlay, safety-rule evals, calibrated judges (#3023)

2026-10-03 18:49:34 -07:00

troubleshooting.md

v1.91.19.0 fix: severe fix wave (truthful gates, no lost memory, every host finds gstack) (#3025)

2026-10-04 07:58:41 -07:00

tutorial-document-generate.md

v1.91.7.0 feat: add functional QA and pre-publication docs checks (#2983)

2026-09-29 06:07:35 -07:00