Commit Graph

2 Commits

Author SHA1 Message Date
Garry Tan 06063eef24 fix: three flaky E2E test fixes
- evals-periodic.yml: hardcode runner (matrix objects don't define
  'runner' property, actionlint catches the error)
- Remove setup-cookies-detect E2E: redundant with 30+ unit tests in
  browse/test/cookie-import-browser.test.ts; E2E just tested LLM
  instruction-following on a CI box with no browsers
- ship-local-workflow: check branch existence on remote instead of
  counting commits (fragile with bare repos + --all)
2026-03-24 14:19:25 -07:00
Garry Tan c4aa31c988 feat: granular touchfiles + 2-tier E2E test system (gate/periodic)
- Shrink GLOBAL_TOUCHFILES from 9 to 3 (only truly global deps)
- Move scoped deps (gen-skill-docs, llm-judge, test-server, worktree,
  codex/gemini session runners) into individual test entries
- Add E2E_TIERS map classifying each test as gate or periodic
- Replace EVALS_FAST with EVALS_TIER env var (gate/periodic)
- Add tier validation test (E2E_TIERS keys must match E2E_TOUCHFILES)
- CI runs only gate tests; periodic tests run weekly via cron
- Add evals-periodic.yml workflow (Monday 6 AM UTC + manual)
- Remove allow_failure flags (gate tests should be reliable)
- Add test:gate and test:periodic scripts, remove test:e2e:fast
2026-03-24 08:15:53 -07:00