CalvinBackup/gstack
1
0 Fork 0
mirror of https://github.com/garrytan/gstack.git synced 2026-11-12 11:40:51 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
cso-python-replay-determinism
gstack/test/fixtures/shard-cli-parity/results.json
T
Garry TanAndrey EsipovMatthew WilliamsRocky Wu
 ac20ef1e13 v1.91.16.0 fix: safe installs and upgrades, skills start everywhere, truthful completion (parallel wave) (#3014) 
* fix(make-pdf,design): real TOC page numbers and anchors; design models move to gpt-5.5 + gpt-image-2 (#2903, #2807)

* ci: pin every action to a SHA, Scorecard, checksummed Bun, scoped Codex CLI in the CI image, macOS named-regressions job (#1948, #1706, #1997)

* fix(cso,browse): Windows/macOS lease identity, retention skips bad runs, truthful 'not assessed' reports, env.kv false positive, Windows browse spawn fixes (#2894, #2912, #2048, #2637, #2805)

* fix(outside-voice): one Codex model precedence for probe and dispatch, bounded timeouts with KILL escalation, probe cache identity, guarded mktemp, skills hidden in nested Codex (#2776, #2914, #2787, #2881, #2847)

* feat(setup): install registry, ./setup --status, staged activation, per-scope migrations, host tiers and conformance kit, OpenCode/Hermes fixes, Copilot CLI (experimental), disabled_skills, slimmer CLAUDE.md (#1925, #2879, #2347, #2338, #2626, #2629, #2825, #2015, #393, #1206, #2096)

Co-authored-by: Andrey Esipov <61357035+andrey-esipov@users.noreply.github.com>
Co-authored-by: Matthew Williams <5863886+ridermw@users.noreply.github.com>
Co-authored-by: Rocky Wu <92764750+lolisaigao1234@users.noreply.github.com>

* fix(preamble): skills start in worktree-isolated Claude Code sessions — one literal skill-start line, context-recovery helper, no eval in skill blocks, $N token tripwire, honest plan-mode precedence (#2763, #2896, #2851)

* fix(setup): per-install renders for renamed, vendored and custom-config installs, space-safe alias roots, per-host /cso launcher path (#1882, #2906)

* test: free tests never write the real HOME (home-write tripwire), no orphaned browse daemons, symlinked-TMPDIR (macOS) fixes, gbrain-on-PATH isolation (#2895, #2816, #2829, #2841, #2982, #2911, #2909, #2908, #2910)

* chore: integrate wave follow-ups — regenerate all hosts, README model docs, TODOS, touchfiles, duration seeds, Bun 1.3 telemetry test fix, replay fixtures pinned to their recorded bytes

* v1.91.14.0: release metadata

* test(browse): group-kill cleanup falls back to the leader when macOS returns EPERM for a live group

* ci: Codex login steps run under bash (the CI container's default sh rejects pipefail)

* fix: full-suite repairs — private state roots for 7 real-HOME writers, truthful home-guard attribution with --attribute-home, gstack-paths shim in ship-hook fixtures, Copilot in team-init probes, test-of-test detector, cookie review fixture pinned to the approved excerpt

* fix(windows): LF for Dockerfiles, normalized home-guard exclusions, path.relative fixture containment, ship push test spawn timeouts

* test(design-detect): widen the whole-scan budget test's timing margins so a loaded macOS runner can't time out the single-batch call

* fix(evals): qa protocol names defined for the judge, async PTY judge so overlapping sessions keep their cleanup deadline, bws setup cases use the standard JUDGE_MS tier

* test(pty): the non-blocking judge case is POSIX-only (its fake judge is a shebang script, like the PTY harness it covers)

* test(evals): ship-coverage-audit names absolute skill paths, uses Read, and skips the Step 7 artifact nothing consumes (removes the mechanism behind 3 of 4 historical timeouts)

* test: deflake terminal-agent concurrent startup (write the placeholder record before spawning, like the product) and qa-evidence resumed pipe (barrier on a full high-water mark instead of a sleep)

* fix(design): daemon log stream handles open errors instead of crashing the daemon; shutdown test awaits the stubbed exit

* test(evals): skillify checks the product's resolved state root (no GSTACK_HOME bypass), negative cases check every root; tpa shims live outside the agent's cwd and answer consistently

* test(evals): coverage-audit detector splits parallel columns at │ rails and [+] groups; coverage prompts name absolute skill paths; TODOs from the gate eval census

* fix(plan-eng-review): scope gate always sends the menu (no headless 'Scope pending' exit); PTY harness ends idle turn-ends and API-error panels promptly with a precise diagnostic

* test(evals): one position-bound coverage-read rule credits read-only && chains (labels, context ranges, git displays in either order) and still rejects forged output

* fix(ship): documentation section has one saved source inserted by cat (never retyped); spawned-marker evidence is the child output; refreshed codex/factory ship goldens

* test(docsync): the byte-exact insert positive is POSIX-only (the bash-command observer refuses backslash paths by design)

* test(evals): plan-design-with-ui focus-title rule accepts the comma-less 'dimensions or focus' wording (replayed on the captured CI run, negative controls kept)

* fix(qa-callers): exploratory preflight says the scope/method Reads come after exploratory.md; design-review scan check credits an executed scan proven by one engine run over the changed files

---------

Co-authored-by: Andrey Esipov <61357035+andrey-esipov@users.noreply.github.com>
Co-authored-by: Matthew Williams <5863886+ridermw@users.noreply.github.com>
Co-authored-by: Rocky Wu <92764750+lolisaigao1234@users.noreply.github.com>
2026-10-03 07:54:09 -07:00

848 lines
18 KiB
JSON
Raw Permalink Blame History

{
"recordedFrom": "96764e80 (pre-engine base runners); paid lane re-recorded at v1.91.12.0 for the marathon tier and the --slice-budget, --max-parallel, --case and --trials flags (PR 2999); free lane re-recorded for the --attribute-home flag (PR 3014)",
"free": [
{
"argv": [],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--dry-run",
"--list",
"--verbose"
],
"result": {
"ok": {
"dryRun": true,
"listOnly": true,
"recordDurations": false,
"windowsOnly": false,
"verbose": true,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--windows-only",
"--list"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": true,
"recordDurations": false,
"windowsOnly": true,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--record-durations"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": true,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--quick"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": true,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--shards",
"4",
"--shard",
"2"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 4,
"shardIndex": 2,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--wall-timeout",
"600"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 600000,
"wallTimeoutExplicit": true,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--ci-plan",
"plan.json",
"--shards",
"20"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": "plan.json",
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--ci-run",
"plan.json",
"--shard",
"1",
"--result",
"result.json"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": 1,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": "plan.json",
"ciVerify": null,
"result": "result.json",
"results": null
}
}
},
{
"argv": [
"--ci-verify",
"plan.json",
"--results",
"results"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": false,
"ciPlan": null,
"ciRun": null,
"ciVerify": "plan.json",
"result": null,
"results": "results"
}
}
},
{
"argv": [
"--bogus"
],
"result": {
"error": "Unknown argument: --bogus"
}
},
{
"argv": [
"--list",
"--bogus"
],
"result": {
"error": "Unknown argument: --bogus"
}
},
{
"argv": [
"--shards"
],
"result": {
"error": "Missing value for --shards"
}
},
{
"argv": [
"--shard"
],
"result": {
"error": "Missing value for --shard"
}
},
{
"argv": [
"--wall-timeout",
"0"
],
"result": {
"error": "--wall-timeout needs a positive integer (seconds)"
}
},
{
"argv": [
"--wall-timeout"
],
"result": {
"error": "--wall-timeout needs a positive integer (seconds)"
}
},
{
"argv": [
"--ci-plan"
],
"result": {
"error": "Missing path for --ci-plan"
}
},
{
"argv": [
"--ci-plan",
"--list"
],
"result": {
"error": "Missing path for --ci-plan"
}
},
{
"argv": [
"--ci-plan",
"a.json",
"--ci-run",
"b.json"
],
"result": {
"error": "CI modes cannot be combined with other selection modes"
}
},
{
"argv": [
"--ci-plan",
"a.json",
"--quick"
],
"result": {
"error": "CI modes cannot be combined with other selection modes"
}
},
{
"argv": [
"--ci-run",
"plan.json"
],
"result": {
"error": "--ci-run requires --shard and --result"
}
},
{
"argv": [
"--ci-verify",
"plan.json"
],
"result": {
"error": "--ci-verify requires --results"
}
},
{
"argv": [
"--quick",
"--shard",
"1"
],
"result": {
"error": "--quick cannot change recording, Windows or shard selection"
}
},
{
"argv": [
"--quick",
"--windows-only"
],
"result": {
"error": "--quick cannot change recording, Windows or shard selection"
}
},
{
"argv": [
"--attribute-home"
],
"result": {
"ok": {
"dryRun": false,
"listOnly": false,
"recordDurations": false,
"windowsOnly": false,
"verbose": false,
"shardCount": 20,
"shardIndex": null,
"wallTimeoutMs": 360000,
"wallTimeoutExplicit": false,
"quick": false,
"attributeHome": true,
"ciPlan": null,
"ciRun": null,
"ciVerify": null,
"result": null,
"results": null
}
}
},
{
"argv": [
"--ci-plan",
"a.json",
"--attribute-home"
],
"result": {
"error": "CI modes cannot be combined with other selection modes"
}
}
],
"paid": [
{
"argv": [],
"result": {
"ok": {
"tier": "gate",
"profile": "full",
"profileExplicit": false,
"listOnly": false,
"skipJudges": false,
"timeoutExplicit": false,
"timeoutMs": 1800000,
"jobs": 8,
"withinShardConcurrency": 2,
"maxFilesPerShard": 1,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": false,
"planPath": null,
"sliceIndex": null,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--list",
"--tier",
"periodic",
"--profile",
"full"
],
"result": {
"ok": {
"tier": "periodic",
"profile": "full",
"profileExplicit": true,
"listOnly": true,
"skipJudges": false,
"timeoutExplicit": false,
"timeoutMs": 1800000,
"jobs": 8,
"withinShardConcurrency": 2,
"maxFilesPerShard": 1,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": false,
"planPath": null,
"sliceIndex": null,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--tier",
"gate",
"--profile",
"pr",
"--list"
],
"result": {
"ok": {
"tier": "gate",
"profile": "pr",
"profileExplicit": true,
"listOnly": true,
"skipJudges": false,
"timeoutExplicit": false,
"timeoutMs": 1800000,
"jobs": 8,
"withinShardConcurrency": 2,
"maxFilesPerShard": 1,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": false,
"planPath": null,
"sliceIndex": null,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--timeout",
"600",
"--jobs",
"2",
"--files-per-shard",
"3"
],
"result": {
"ok": {
"tier": "gate",
"profile": "full",
"profileExplicit": false,
"listOnly": false,
"skipJudges": false,
"timeoutExplicit": true,
"timeoutMs": 600000,
"jobs": 2,
"withinShardConcurrency": 2,
"maxFilesPerShard": 3,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": true,
"planPath": null,
"sliceIndex": null,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--emit-plan",
"manifest.json",
"--slices",
"4",
"--skip-judges"
],
"result": {
"ok": {
"tier": "gate",
"profile": "full",
"profileExplicit": false,
"listOnly": false,
"skipJudges": true,
"timeoutExplicit": false,
"timeoutMs": 1800000,
"jobs": 8,
"withinShardConcurrency": 2,
"maxFilesPerShard": 1,
"emitPlanPath": "manifest.json",
"slices": 4,
"sliceBudgetMs": null,
"jobsExplicit": false,
"planPath": null,
"sliceIndex": null,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--plan",
"manifest.json",
"--slice",
"2"
],
"result": {
"ok": {
"tier": "gate",
"profile": "full",
"profileExplicit": false,
"listOnly": false,
"skipJudges": false,
"timeoutExplicit": false,
"timeoutMs": 1800000,
"jobs": 8,
"withinShardConcurrency": 2,
"maxFilesPerShard": 1,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": false,
"planPath": "manifest.json",
"sliceIndex": 2,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--report",
"reports",
"--write-durations"
],
"result": {
"ok": {
"tier": "gate",
"profile": "full",
"profileExplicit": false,
"listOnly": false,
"skipJudges": false,
"timeoutExplicit": false,
"timeoutMs": 1800000,
"jobs": 8,
"withinShardConcurrency": 2,
"maxFilesPerShard": 1,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": false,
"planPath": null,
"sliceIndex": null,
"reportDir": "reports",
"writeDurations": true,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [],
"env": {
"EVALS_TIER": "periodic",
"EVALS_JOBS": "3",
"EVALS_CONCURRENCY": "5",
"EVALS_SHARD_TIMEOUT_MS": "1000",
"EVALS_PROFILE": "full"
},
"result": {
"ok": {
"tier": "periodic",
"profile": "full",
"profileExplicit": true,
"listOnly": false,
"skipJudges": false,
"timeoutExplicit": true,
"timeoutMs": 1000,
"jobs": 3,
"withinShardConcurrency": 5,
"maxFilesPerShard": 1,
"emitPlanPath": null,
"slices": 1,
"sliceBudgetMs": null,
"jobsExplicit": true,
"planPath": null,
"sliceIndex": null,
"reportDir": null,
"writeDurations": false,
"maxParallel": null,
"caseId": null,
"trials": null
}
}
},
{
"argv": [
"--bogus"
],
"result": {
"error": "Unknown argument: --bogus"
}
},
{
"argv": [
"--list",
"--bogus"
],
"result": {
"error": "Unknown argument: --bogus"
}
},
{
"argv": [
"--tier",
"e2e"
],
"result": {
"error": "--tier must be gate, periodic or marathon. Received: e2e"
}
},
{
"argv": [
"--tier"
],
"result": {
"error": "--tier must be gate, periodic or marathon. Received: -"
}
},
{
"argv": [
"--profile"
],
"result": {
"error": "--profile needs pr or full"
}
},
{
"argv": [
"--profile",
"fast"
],
"result": {
"error": "--profile must be pr or full. Received: fast"
}
},
{
"argv": [
"--timeout",
"0"
],
"result": {
"error": "--timeout needs a positive integer. Received: 0"
}
},
{
"argv": [
"--jobs"
],
"result": {
"error": "--jobs needs a positive integer. Received: undefined"
}
},
{
"argv": [
"--emit-plan"
],
"result": {
"error": "--emit-plan needs a file path"
}
},
{
"argv": [
"--plan"
],
"result": {
"error": "--plan needs a manifest path"
}
},
{
"argv": [
"--report"
],
"result": {
"error": "--report needs a directory"
}
},
{
"argv": [
"--write-durations"
],
"result": {
"error": "--write-durations requires --report"
}
},
{
"argv": [
"--skip-judges"
],
"result": {
"error": "--skip-judges applies only to an emitted gate census plan"
}
},
{
"argv": [
"--profile",
"pr",
"--tier",
"periodic"
],
"result": {
"error": "PR profile requires gate tier"
}
},
{
"argv": [
"--profile",
"pr",
"--files-per-shard",
"2"
],
"result": {
"error": "PR profile requires one file per shard to preserve case accounting"
}
},
{
"argv": [],
"env": {
"EVALS_TIER": "e2e"
},
"result": {
"error": "EVALS_TIER must be gate, periodic or marathon. Received: e2e"
}
}
],
"unknownArgumentCli": {
"free": {
"status": 1,
"stderr": "[test:free] Unknown argument: --bogus"
},
"paid": {
"status": 1,
"stderr": "[test:paid] Unknown argument: --bogus"
}
}
}
Reference in new issue View Git Blame Copy Permalink