Garry Tan 86bc2e993c test(office-hours): retier builder-wildness from gate to periodic ...

The office-hours-builder-wildness E2E is an LLM-judge creativity score
(axis_a ≥4 on /office-hours BUILDER output, axis_b ≥4 on same).
Per CLAUDE.md tier-classification rules — "Quality benchmark, Opus model
test, or non-deterministic? -> periodic" — this test belongs in periodic,
not gate.

The wave's +21-line CJK preamble cascade (#1205) dropped the same prompt
from a 5/5 score on main to 3/3 on the wave with identical model + fixture
+ retry budget. Same generator, same judge, different preamble byte count
in the run-time context. That's noise the gate tier shouldn't surface as
a blocking failure.

Functional gates (office-hours-spec-review, office-hours-forcing-energy)
remain on gate — they test structure, not creativity.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-11 09:47:12 -07:00

..

providers

v1.30.0.0 fix wave: 21 community PRs + Windows CI extension + codex flag-semantics smoke (#1391)

2026-05-09 08:06:47 -07:00

agent-sdk-runner.ts

v1.24.0.0 feat: cross-platform hardening — curated Windows lane + Bun.which resolver + path-portability helper (#1252)

2026-05-01 07:21:28 -07:00

benchmark-judge.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

benchmark-runner.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

claude-pty-runner.ts

v1.31.0.0 fix: delete AskUserQuestion fallback (root cause of forever war) + harness primitives (#1390)

2026-05-09 17:01:13 -07:00

claude-pty-runner.unit.test.ts

v1.31.0.0 fix: delete AskUserQuestion fallback (root cause of forever war) + harness primitives (#1390)

2026-05-09 17:01:13 -07:00

codex-session-runner.ts

fix: enforce Codex 1024-char description limit + auto-heal stale installs (v0.11.9.0) (#391)

2026-03-23 08:44:08 -07:00

e2e-helpers.ts

v1.25.1.0 fix: office-hours Phase 4 STOP gate + AskUserQuestion recommendation judge (#1296)

2026-05-01 19:51:51 -07:00

eval-store.test.ts

feat: QA restructure, browser ref staleness, eval efficiency metrics (v0.4.0) (#83)

2026-03-15 23:55:39 -05:00

eval-store.ts

test: bump remaining claude-opus-4-6 → 4-7 references

2026-05-10 11:08:26 -07:00

gemini-session-runner.test.ts

feat: Gemini CLI E2E tests (v0.9.2.0) (#252)

2026-03-20 08:30:09 -07:00

gemini-session-runner.ts

feat: Gemini CLI E2E tests (v0.9.2.0) (#252)

2026-03-20 08:30:09 -07:00

llm-judge.ts

v1.25.1.0 fix: office-hours Phase 4 STOP gate + AskUserQuestion recommendation judge (#1296)

2026-05-01 19:51:51 -07:00

observability.test.ts

fix: never clean up observability artifacts — partial file persists after finalize

2026-03-14 12:37:38 -05:00

pricing.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

secret-sink-harness.ts

v1.12.0.0 feat: /setup-gbrain — coding-agent onboarding for gbrain (#1183)

2026-04-24 01:38:21 -07:00

session-runner.test.ts

feat: stream-json NDJSON parser for real-time E2E progress

2026-03-14 03:49:36 -05:00

session-runner.ts

fix(checkpoint): rename /checkpoint → /context-save + /context-restore (v1.0.1.0) (#1064)

2026-04-19 08:38:19 +08:00

skill-parser.ts

feat: content security — 4-layer prompt injection defense for pair-agent (#815)

2026-04-06 14:41:06 -07:00

tool-map.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

touchfiles.ts

test(office-hours): retier builder-wildness from gate to periodic

2026-05-11 09:47:12 -07:00