Garry Tan 03a6270b9c feat: eval efficiency metrics — turns, duration, commentary across all surfaces ...

Add generateCommentary() for natural-language delta interpretation,
per-test turns/duration in comparison and summary output, judgePassed
unit tests, 3 new E2E tests (qa-only, qa fix loop, plan artifact).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-15 21:17:12 -05:00

..

eval-store.test.ts

feat: eval efficiency metrics — turns, duration, commentary across all surfaces

2026-03-15 21:17:12 -05:00

eval-store.ts

feat: eval efficiency metrics — turns, duration, commentary across all surfaces

2026-03-15 21:17:12 -05:00

llm-judge.ts

feat: 3-tier eval suite with planted-bug outcome testing (EVALS=1)

2026-03-14 01:17:36 -05:00

observability.test.ts

fix: never clean up observability artifacts — partial file persists after finalize

2026-03-14 12:37:38 -05:00

session-runner.test.ts

feat: stream-json NDJSON parser for real-time E2E progress

2026-03-14 03:49:36 -05:00

session-runner.ts

fix: auto-clear stale heartbeat when process is dead

2026-03-14 12:55:40 -05:00

skill-parser.ts

feat: 3-tier eval suite with planted-bug outcome testing (EVALS=1)

2026-03-14 01:17:36 -05:00