mirror of
https://github.com/garrytan/gstack.git
synced 2026-09-13 08:29:04 +02:00
docs: update project documentation for v1.77.0.0
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
co-authored by
Claude Fable 5
parent
7cb0f2d93a
commit
71b2a0168b
+4
-3
@@ -236,6 +236,7 @@ When E2E tests run, they produce machine-readable artifacts in `~/.gstack-dev/`:
|
||||
bun run eval:list # list all eval runs (turns, duration, cost per run)
|
||||
bun run eval:compare # compare two runs — shows per-test deltas + Takeaway commentary
|
||||
bun run eval:summary # aggregate stats + per-test efficiency averages across runs
|
||||
bun run eval:flake-rank # rank tests by flake signal: retried passes first, then failure rate (--json, --dir, --since-days)
|
||||
```
|
||||
|
||||
**Detached runs for agents and long suites.** When an agent (or you, for a run
|
||||
@@ -264,9 +265,9 @@ distinguishes failed vs timed-out vs never-started shards. The runner also
|
||||
selects by diff: shards untouched by your branch are reported as
|
||||
skipped-by-diff, with a selection banner naming the reason (`EVALS_ALL=1`
|
||||
forces everything). `EVALS_JOBS` sets how many shard processes run at once
|
||||
(default 4); `EVALS_CONCURRENCY` is bun's concurrency WITHIN a shard — they
|
||||
are deliberately separate knobs. `eval:list`,
|
||||
`eval:compare`, and `eval:summary` are shard-aware. Humans running
|
||||
(default 8); `EVALS_CONCURRENCY` is bun's concurrency WITHIN a shard
|
||||
(default 2) — they are deliberately separate knobs. `eval:list`,
|
||||
`eval:compare`, `eval:summary`, and `eval:flake-rank` are shard-aware. Humans running
|
||||
`bun run test:evals` foreground in their own terminal don't need this — Ctrl-C
|
||||
is intended there.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user