Garry TanandClaude Fable 5 bd11416d80 fix(evals): absorb codex/gemini CLI drift; external-service tests go periodic-tier ...

- codex exec gains --skip-git-repo-check: newer CLIs refuse exec in an
  untrusted non-git dir (our temp skill dirs) — empirically verified.
- gemini: --skip-trust was removed in gemini-cli 0.34 (argv parse error);
  dropped from the session runner and the benchmark adapter. A present-
  but-unusable CLI (deprecated individual code-assist auth path) now
  classifies as SKIP, not a false adapter failure; the benchmark live
  smoke skips on auth/rate_limit error codes (environmental) while still
  failing on timeout/unknown (the drift classes it exists to catch).
- codex-e2e, gemini-e2e, and benchmark-providers gain the canonical
  whole-file EVALS_TIER === 'periodic' guard per CLAUDE.md tiering rule 3
  (external service -> periodic) — the sharded gate runner now excludes
  all three (gate: 45 -> 42 shards).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-08-13 10:34:25 -07:00

..

claude.ts

v1.57.2.0 feat: AskUserQuestion prose fallback when the tool fails at runtime (#1908)

2026-06-07 21:38:21 -07:00

gemini.test.ts

test(benchmark): full post-CLI gemini e2e + GEMINI_API_KEY auth path

2026-07-10 09:38:06 -07:00

gemini.ts

fix(evals): absorb codex/gemini CLI drift; external-service tests go periodic-tier

2026-08-13 10:34:25 -07:00

gpt.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00

types.ts

feat(v1.3.0.0): open agents learnings + cross-model benchmark skill (#1040)

2026-04-19 17:50:31 +08:00