mirror of
https://github.com/garrytan/gstack.git
synced 2026-08-11 08:40:22 +02:00
v1.60.2.0 fix: free-suite drift on dev machines (eval-list cwd, gemini regex, observability floor) (#2470)
* fix(test): eval-list CLI spawns from neutral cwd so slug detection can't dodge the fixture store
getProjectEvalDir() probes cwd-relative .claude/skills/gstack/bin/gstack-slug;
with cwd=ROOT on a dev machine the self-symlink makes it succeed, routing reads
to an empty project-scoped dir instead of the seeded legacy ~/.gstack-dev/evals.
Neutral cwd + absolute script path fails both probes deterministically — same
behavior as CI.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* fix(test): case-insensitive remediation-hint match for reworded Gemini NOT-READY message
The message now leads with 'Export GEMINI_API_KEY...' (free-tier OAuth
deprecation); the old pattern only knew lowercase 'export'.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* fix(test): observability check 11 floor 6 -> 5 after shell-free spawn removed promptFile unlink
aa3bd6f0 deleted the prompt temp file (and its /* non-fatal */ marker) when it
dropped shell interpolation. The invariant — every runner I/O path wrapped
non-fatally — still holds at the 5 remaining sites, now named in the comment.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* docs(todos): P1 — free-suite exit code masked by in-process force-exits
Five browse test files setTimeout(() => process.exit(0), 500) inside the shared
bun process; the suite can exit 0 before the summary with real failures masked.
Receipts + fix path filed.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* chore(release): v1.60.2.0
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Fable 5
parent
a3259400a3
commit
960c3a8d6c
@@ -51,8 +51,14 @@ function writeEvalRun(evalDir: string, filename: string, timestamp: string, turn
|
||||
}
|
||||
|
||||
function runEvalList(...args: string[]): { stdout: string; stderr: string; status: number } {
|
||||
const result = spawnSync('bun', ['run', 'scripts/eval-list.ts', ...args], {
|
||||
cwd: ROOT,
|
||||
// cwd is the temp HOME, NOT the repo root: getProjectEvalDir() probes the
|
||||
// cwd-relative .claude/skills/gstack/bin/gstack-slug, and on dev machines
|
||||
// with the self-symlink that probe succeeds, routing reads to an (empty)
|
||||
// project-scoped dir instead of the legacy ~/.gstack-dev/evals this test
|
||||
// seeds. A neutral cwd makes both slug probes fail deterministically, so
|
||||
// the CLI always uses the seeded legacy dir — same behavior as CI.
|
||||
const result = spawnSync('bun', ['run', path.join(ROOT, 'scripts', 'eval-list.ts'), ...args], {
|
||||
cwd: tmpHome,
|
||||
env: {
|
||||
...process.env,
|
||||
HOME: tmpHome,
|
||||
|
||||
Reference in New Issue
Block a user