Garry Tan 91bbd9e6c4 v1.91.69.0 fix(cso-eval): producers keep usage on timeout, give the agent reporting time, and accept the helper's own artifact names (#3111) ...

- every helper artifact path tripped the secret redactor: the run ID's
  13-digit epoch reads as a phone number, some 32-hex IDs as wallets.
  Validate paths against the helper layout; schema-shaped ID components
  are accepted by shape, every other component still goes through redact
- the provider was killed at exactly --budget after cell start, before
  the helper deadline (start + budget) and before finish; give it the
  budget plus a 300 s reporting grace (evaluator graceSeconds)
- Claude producers stream events (stream-json --verbose
  --include-partial-messages) and add usage per message, so a timed-out
  receipt keeps tokens, cost, turns and the last text
- failed post-run checks name the check in the receipt reason

2026-10-10 18:59:17 +00:00

..

claude-stream.ts

v1.91.69.0 fix(cso-eval): producers keep usage on timeout, give the agent reporting time, and accept the helper's own artifact names (#3111)

2026-10-10 18:59:17 +00:00

claude.ts

v1.91.69.0 fix(cso-eval): producers keep usage on timeout, give the agent reporting time, and accept the helper's own artifact names (#3111)

2026-10-10 18:59:17 +00:00

gemini.test.ts

test(benchmark): full post-CLI gemini e2e + GEMINI_API_KEY auth path

2026-07-10 09:38:06 -07:00

gemini.ts

v1.91.66.0 fix: /autoplan without permission prompts after background reviewers, 34 contributor PRs from the backlog triage (#3087)

2026-10-08 17:40:06 +00:00

gpt.ts

v1.91.66.0 fix: /autoplan without permission prompts after background reviewers, 34 contributor PRs from the backlog triage (#3087)

2026-10-08 17:40:06 +00:00

types.ts

v1.91.8.0 test: smaller suite, derived paid selection, retired never-green evals (#2994)

2026-09-29 08:58:49 -07:00