gstack

mirror of https://github.com/garrytan/gstack.git synced 2026-05-05 13:15:24 +02:00

Files

T

Garry Tan 219599076f feat: Codex E2E test harness — verify skills work on Codex CLI

New test infrastructure:
- CodexSessionRunner: spawns codex exec, parses JSONL stream, returns
  structured results (output, reasoning, toolCalls, tokens)
- JSONL parser ported from Python (codex/SKILL.md.tmpl) to TypeScript
- Temp HOME skill installation for Codex discovery testing

E2E tests (gated behind EVALS=1 + codex + OPENAI_API_KEY):
- codex-discover-skill: installs skill, verifies Codex finds it
- codex-review-findings: runs gstack-review via Codex, validates output

Integrates with existing eval infrastructure:
- Diff-based test selection via touchfiles
- Eval persistence via EvalCollector
- bun run test:codex / test:codex:all convenience scripts

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-19 01:10:51 -07:00

codex-session-runner.ts

feat: Codex E2E test harness — verify skills work on Codex CLI

2026-03-19 01:10:51 -07:00

eval-store.test.ts

feat: QA restructure, browser ref staleness, eval efficiency metrics (v0.4.0) (#83 )

2026-03-15 23:55:39 -05:00

eval-store.ts

feat: QA restructure, browser ref staleness, eval efficiency metrics (v0.4.0) (#83 )

2026-03-15 23:55:39 -05:00

llm-judge.ts

feat: 3-tier eval suite with planted-bug outcome testing (EVALS=1)