v1.91.183.0 fix(evals): a rejected API key is INFRA, never 131 assertion reds and reruns (#3361)

Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
This commit is contained in:
garrytanandcapy-ai[bot] committed 2026-10-23 17:53:08 +00:00
1 parent 4a18fd3daa
commit 510053d16f
4 files changed
+4 -4

No files matched your search

+1 -1
View File
@@ -1,6 +1,6 @@
# Changelog
## [Unreleased]
## [1.91.183.0] - 2026-10-23
**A rejected API key no longer turns a gate into 131 assertion reds and 131 reruns.** Train gate run 39696775546 ran with a rejected `ANTHROPIC_API_KEY`. Every case failed on a 401 before the model ran, and the report counted them as assertion failures. Rule 16 then reran all 131 cases with the same key. A trial whose provider rejected the run's credentials is now INFRA: the gate never reruns it, the verdict counts it under INFRA, and its failure line reads `credentials rejected: Invalid API key · …`. A real assertion failure that only mentions a key keeps its class and is still rerun.
+1 -1
View File
@@ -1 +1 @@
1.91.182.0
1.91.183.0
+1 -1
View File
@@ -1,4 +1,4 @@
# gstack digest v1.91.182.0 — regenerate/re-copy after upgrading gstack
# gstack digest v1.91.183.0 — regenerate/re-copy after upgrading gstack
Behavioral rules from gstack (https://github.com/garrytan/gstack), compressed
for agent hosts without a full skill install. The full skills add workflows,
+1 -1
View File
@@ -1,6 +1,6 @@
{
"name": "gstack",
"version": "1.91.182",
"version": "1.91.183",
"description": "Garry's Stack — Claude Code skills + fast headless browser. One repo, one install, entire AI engineering workflow.",
"license": "MIT",
"type": "module",