Garry TanandClaude Fable 5 c9e9a653cf feat(evals): arm benchmark runs each fixture's functional oracle — correctness before LOC ...

The plan's metric order is diff-quality FIRST, but cells never ran the
fixtures' own run-tests.js, so a refusal, a broken implementation, and
working code were indistinguishable in aggregates (Codex adversarial catch).
Tasks with an oracle declare checkCmd; every cell records checks=pass|fail|none
in the report line and eval store. Selftest pins the oracle declarations and
that the planted bug fails its own check pre-fix.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-08-29 05:57:56 +00:00

..

providers

v1.65.0.0 feat: fork port wave 2 — feature fixes, session persistence, Apple releases, supply-chain CI (#2577)

2026-08-15 11:42:19 -07:00

agent-sdk-runner.ts

v1.66.0.0 feat: test/evals/CI speedup — 90s truthful free suite, diff-billed evals, required Linux lane (#2593)

2026-08-15 22:20:30 -07:00

anthropic-preflight.ts

v1.66.0.0 feat: test/evals/CI speedup — 90s truthful free suite, diff-billed evals, required Linux lane (#2593)

2026-08-15 22:20:30 -07:00

arm-benchmark-harness.ts

feat(evals): arm benchmark runs each fixture's functional oracle — correctness before LOC

2026-08-29 05:57:56 +00:00

auq-sdk-capture.ts

v1.65.0.0 feat: fork port wave 2 — feature fixes, session persistence, Apple releases, supply-chain CI (#2577)

2026-08-15 11:42:19 -07:00

benchmark-judge.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

benchmark-runner.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

budget-override.test.ts

v1.46.0.0 feat: gstack v2 foundation — catalog tokens drop 56%, eval-first floor covers all 51 skills (#1712)

2026-05-26 16:50:03 -07:00

budget-override.ts

v1.46.0.0 feat: gstack v2 foundation — catalog tokens drop 56%, eval-first floor covers all 51 skills (#1712)

2026-05-26 16:50:03 -07:00

capture-context-budget.ts

v1.71.0.0 feat: token-load reduction — preamble runtime scripts, gated onboarding, 20 skill carves, CLAUDE.md trim (#2691)

2026-08-27 09:50:31 -07:00

capture-parity-baseline.test.ts

v1.46.0.0 feat: gstack v2 foundation — catalog tokens drop 56%, eval-first floor covers all 51 skills (#1712)

2026-05-26 16:50:03 -07:00

capture-parity-baseline.ts

v1.66.0.0 feat: test/evals/CI speedup — 90s truthful free suite, diff-billed evals, required Linux lane (#2593)

2026-08-15 22:20:30 -07:00

carve-guard-checks.ts

v1.57.0.0 feat: carve-guard system + carve cso/document-release/design-consultation (#1907)

2026-06-07 19:13:24 -07:00

carve-guards.ts

Merge remote-tracking branch 'origin/main' into ponytail-inspiration-review

2026-08-29 04:33:10 +00:00

claude-pty-runner.scope-gate-floor.unit.test.ts

v1.62.0.0 feat: plan-mode auto-select at the review scope gate (#2533)

2026-08-12 11:12:28 -07:00

claude-pty-runner.ts

v1.65.0.0 feat: fork port wave 2 — feature fixes, session persistence, Apple releases, supply-chain CI (#2577)

2026-08-15 11:42:19 -07:00

claude-pty-runner.unit.test.ts

v1.62.0.0 feat: plan-mode auto-select at the review scope gate (#2533)

2026-08-12 11:12:28 -07:00

codex-session-runner.ts

v1.67.2.0 feat: gpt-5.6-sol bounded-scope profile for Codex installs (#2633)

2026-08-18 17:00:04 -07:00

e2e-gate.ts

v1.64.1.0 v1.64.1.0: the code-smell fix wave — every pipeline guard now provably fires (net −24,943 lines) (#2572)

2026-08-15 09:37:04 -07:00

e2e-gate.unit.test.ts

v1.64.1.0 v1.64.1.0: the code-smell fix wave — every pipeline guard now provably fires (net −24,943 lines) (#2572)

2026-08-15 09:37:04 -07:00

e2e-helpers.ts

feat(evals): with-skill vs without-skill arm benchmark — measures whether gstack's behavioral layer earns its tokens

2026-08-28 02:07:56 +00:00

emulate-bun-windows-eexist.ts

v1.69.0.0 fix: the silent-failure wave — 6 fixes, 5 community PRs absorbed, tracker closed with receipts (#2666)

2026-08-24 08:55:58 -07:00

eval-store.test.ts

test: absorb the ponytail-import wave into the guard fixtures — ceilings, schema pin, triad phrasing

2026-08-28 02:36:09 +00:00

eval-store.ts

feat(evals): with-skill vs without-skill arm benchmark — measures whether gstack's behavioral layer earns its tokens

2026-08-28 02:07:56 +00:00

fs-caps.ts

v1.72.0.0 feat: Aside recommended driver for third-party web actions (#2710)

2026-08-28 11:43:13 -07:00

gemini-session-runner.test.ts

feat: Gemini CLI E2E tests (v0.9.2.0) (#252)

2026-03-20 08:30:09 -07:00

gemini-session-runner.ts

v1.63.0.0 feat: GStack 2 fork port wave — egress receipts, context-bill, sharded gate, /health fix (#2541)

2026-08-14 09:28:56 -07:00

hermetic-env.test.ts

v1.58.1.0 feat: hermetic local E2E + Conductor prose AskUserQuestion (#2004)

2026-06-14 11:40:57 -07:00

hermetic-env.ts

v1.71.0.0 feat: token-load reduction — preamble runtime scripts, gated onboarding, 20 skill carves, CLAUDE.md trim (#2691)

2026-08-27 09:50:31 -07:00

llm-judge.ts

fix(evals): arm-benchmark harvest and judge hardening

2026-08-29 05:18:52 +00:00

observability.test.ts

test: observability partial-file pin follows eval-store schema v2

2026-08-28 02:43:17 +00:00

paid-test-set.ts

v1.67.2.0 feat: gpt-5.6-sol bounded-scope profile for Codex installs (#2633)

2026-08-18 17:00:04 -07:00

parity-harness.ts

v1.71.0.0 feat: token-load reduction — preamble runtime scripts, gated onboarding, 20 skill carves, CLAUDE.md trim (#2691)

2026-08-27 09:50:31 -07:00

pricing.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

required-reads.ts

v1.54.0.0 feat: carve /ship into skeleton + on-demand sections (-59% always-loaded) (#1806)

2026-05-30 12:09:10 -07:00

scratch-repo.ts

v1.66.1.0 feat: content binding — evidence ledger, wtree staleness, tracker trust envelope, fail-closed hooks (#2603)

2026-08-16 09:53:31 -07:00

secret-sink-harness.ts

v1.12.0.0 feat: /setup-gbrain — coding-agent onboarding for gbrain (#1183)

2026-04-24 01:38:21 -07:00

session-runner.test.ts

feat: stream-json NDJSON parser for real-time E2E progress

2026-03-14 03:49:36 -05:00

session-runner.ts

fix(test-harness): spawn claude without shell interpolation

2026-07-14 12:56:07 -07:00

setup-gbrain-fixture.ts

v1.71.0.0 feat: token-load reduction — preamble runtime scripts, gated onboarding, 20 skill carves, CLAUDE.md trim (#2691)

2026-08-27 09:50:31 -07:00

skill-census.ts

v1.63.0.0 feat: GStack 2 fork port wave — egress receipts, context-bill, sharded gate, /health fix (#2541)

2026-08-14 09:28:56 -07:00

skill-fixture.ts

v1.66.0.0 feat: test/evals/CI speedup — 90s truthful free suite, diff-billed evals, required Linux lane (#2593)

2026-08-15 22:20:30 -07:00

skill-parser.ts

feat: content security — 4-layer prompt injection defense for pair-agent (#815)

2026-04-06 14:41:06 -07:00

test-selection.ts

v1.66.0.0 feat: test/evals/CI speedup — 90s truthful free suite, diff-billed evals, required Linux lane (#2593)

2026-08-15 22:20:30 -07:00

tool-map.ts

v1.67.0.0 fix: the tracker wave — XProtect self-heal, complete installs, brain-sync integrity, 31 community PRs credited (#2604)

2026-08-16 19:34:41 -07:00

touchfiles-data.ts

refactor(evals): arm-benchmark selftest runs FREE on every PR

2026-08-29 05:42:57 +00:00

touchfiles.ts

v1.66.0.0 feat: test/evals/CI speedup — 90s truthful free suite, diff-billed evals, required Linux lane (#2593)

2026-08-15 22:20:30 -07:00

transcript-section-logger.ts

v1.54.0.0 feat: carve /ship into skeleton + on-demand sections (-59% always-loaded) (#1806)

2026-05-30 12:09:10 -07:00