mirror of
https://github.com/garrytan/gstack.git
synced 2026-10-05 10:57:15 +02:00
v1.91.7.0 feat: add functional QA and pre-publication docs checks (#2983)
* feat: add surface-aware exploratory QA and ship documentation gates * test: preserve delegated QA setup authority after main integration * fix(qa): clarify exploration order and preserve report artifacts * test(qa): follow the shared setup reference directly * refactor(ship): make verification and recovery routes explicit * test(ship): align evidence and review guards with explicit routes * fix(workflows): clarify ship recovery and functional QA evidence * fix(workflows): clarify approval recovery and full QA coverage * refactor(workflows): order review transactions and clarify ship state * fix(ship): clarify final verification and fail closed at publication * fix(evals): attribute native atomic documentation writes * fix(ship): clarify recovery and documentation lifecycle guidance * fix(test): preserve observed native placeholder styling in CI * fix(codex): report watchdog timeouts without a process-exit race * Checkpoint functional QA implementation and workflow validation repairs * Fix documentation and shared-review fixture contracts * docs: clarify judge reuse and evaluation supervision * test: align review evidence and selected case contracts * test: verify append-only documentation checkpoints and recovery * fix: qualify QA workflows and CI validation repairs * fix: launch shared-libs fixture scripts on Windows * fix: qualify QA deadlines, fixture isolation, and shard cleanup * fix: preserve qualified QA and cancellation repairs * fix: enforce functional fixture authority and share strict event decoding * fix: retain free-test evidence and explain recovery * fix: reject malformed native evidence after decoder consolidation * test: use reliable capture for telemetry privacy filters * test: refresh measured quick coverage and document validation costs * Fix native fixture receipts and preserve VM validation evidence * Align negative judge controls with upstream clarity policy * Fix report-only QA preparation and public evidence handling * Clarify QA-only preparation and current-report preservation * Stream Ship quality judgments with an explicit 64k response contract * Validate compact judge reasoning locally with supported wire schema * Align functional QA fixture instructions with evidence acceptance * Bind native browser diagnostics to execution evidence and align review verdicts * Preserve native diagnostic line boundaries * Serialize functional QA evidence from native captures * Keep large QA evidence fixture payload out of Windows argv
This commit is contained in:
1 parent
65bfb0ce49
commit
dcaea52800
333 files changed
+41755
-7357
No files matched your search
@@ -102,9 +102,10 @@ integration tests, the Aside contract pins, and the render-wrapper pins.
|
||||
It reports deferred broad coverage; unknown dependencies restore the full gate,
|
||||
and an unmapped prompt without registered coverage blocks planning. Full free
|
||||
acceptance and required PR checks must pass before publishing. CI can reuse the
|
||||
14 workflow-judge passes for 24 hours when their complete consumed inputs and
|
||||
runtime match; records preserve original provenance. The other 11 judge cases,
|
||||
dynamic agent tests, and local runs without scoped cache configuration stay fresh.
|
||||
16 workflow-judge passes for 24 hours when their complete consumed inputs and
|
||||
runtime match; records preserve original provenance. The cookie workflow's custom
|
||||
input, the other 11 judge cases, dynamic agent tests, and local runs without
|
||||
scoped cache configuration stay fresh.
|
||||
Scheduled/manual full coverage and `test:release` always run fresh.
|
||||
See [testing policy](CONTRIBUTING.md#test-tiers) for commands and measured targets.
|
||||
Anything that needs Aside
|
||||
@@ -726,7 +727,7 @@ the run can also die to idle-sleep. `gstack-detach` fixes both: a fresh session
|
||||
(stray `claude`/`codex` grandchildren included), a per-shard
|
||||
`GSTACK_EVAL_DIR=<evalDir>/shards/<slug>/` honored by the `EvalCollector`
|
||||
constructor, and an aggregate that separates failed vs timed-out vs
|
||||
never-started shards — the detach timeouts (28800s gate / 60600s periodic;
|
||||
never-started shards — the detach timeouts (47340s gate / 67380s periodic;
|
||||
floor enforced against the live shard census by
|
||||
test/eval-detach-timeout-floor.test.ts)
|
||||
are sized against worst-case shard wall clock. `EVALS_JOBS` sets the shard
|
||||
|
||||
Reference in new issue
Block a user