mirror of
https://github.com/garrytan/gstack.git
synced 2026-09-16 18:05:31 +02:00
* feat: add a restricted and supervised Claude Code runner Preserve configured authentication and models while enforcing tool access, strict completion JSON, bounded output and process cleanup. Cover argv, failure handling, session metadata and Windows process containment. * feat: route outside reviews by harness and migrate wrapper installs Use Claude Code from Codex and Codex from other supported hosts, with shared invocation rendering, positive gate validation and per-phase provenance. Rename /claude to /claude-code, repair managed shared and copied installations safely, and generate native Kiro skills. Add installed-workflow, failure-injection and live cross-harness regression coverage. * test: recognize CEO mode labels without terminal spacing The paid workflow rendered SCOPEEXPANSION at option 4, but its driver required a literal space. Match the leading mode title without cursor-spacing artifacts and ignore adjacent preview text. Preserve missing-target failures and downstream posture assertions. * test: isolate plan-count fixtures before starting review workflows Seed the complete test plan in a private git repository before launching Claude, so a bare slash command cannot review the live workspace while a delayed fixture message remains queued. Preserve count thresholds, parsers and budgets. Add initial-context and installed-discovery tests, and retain startup/terminal diagnostics on failed evaluations. * test: stabilize review fixtures and Claude eval startup Preserve source boundaries in workflow judge inputs, isolate CEO mode plans, and wait for interactive trust input readiness. Keep startup failure evidence and retain existing models, budgets, and assertions. Co-Authored-By: OpenAI Codex <noreply@openai.com> * test: classify collapsed review modes and isolate seeded findings Keep review questions out of the setup count when terminal cursor positioning removes spaces. State existing webhook safeguards so the five-finding control measures its seeded defects without accidental extra security and concurrency gaps. Preserve question bands and the paired control. Co-Authored-By: OpenAI Codex <noreply@openai.com> * test: isolate browser daemon state across free shards Co-Authored-By: OpenAI Codex <noreply@openai.com> * test: stabilize native review counting and interactive navigation Co-Authored-By: OpenAI Codex <noreply@openai.com> * chore: prepare v1.82.0.0 release Co-Authored-By: OpenAI Codex <noreply@openai.com> * fix: eliminate browser and process-cleanup test flakes Pin every CI surface to Bun 1.4.0 to avoid extra-stdio finalizers closing reused live sockets. Add an isolated GC/listener regression that fails on Bun 1.3.13, and prevent coordinated rollback to an affected CI runtime. Check renderer cleanup against the render's own staging directory so concurrent renders cannot invalidate the assertion. Make the no-pgrep process-tree walk tolerate disappearing /proc entries, and synchronize its test fixture through child readiness and pipe EOF instead of sleeps. Validation: 9,157 passed, 31 skipped, zero failures across 556 files with retries disabled. Build, all-host generation freshness, and skill checks passed. All three races have failing-before/passing-after regressions. * fix: count completed native review questions in evals * fix: drive review navigation from confirmed native choices * fix: require complete section-loading eval reports * test: isolate telemetry HTTP transport from local assertions * fix: keep review input on the active native question * test: let tunnel revocation daemon choose an available port * test: allocate available ports for pairing and watchdog fixtures * fix: stabilize planning eval navigation and phase reporting * test: isolate installed runtime paths in planning evals * test: stabilize review evidence and concurrent refresh fixtures * fix: resolve design findings before editing the plan * fix: honor and persist disabled outside plan reviews * fix: preserve planning decisions and terminal evidence Load installed host reviews at autoplan phase entry and wait for completed reviewers and saved artifacts. Reuse approved remedies while preserving individual finding decisions. Drive interactive evals from the current terminal viewport, bind native questions across scrolling, and require complete native report evidence. Cover captured stale menus, permission lifecycles, setup classification, and disabled-review tool availability with deterministic regressions. Advance release metadata and the upgrade migration to the unclaimed 1.83.0.0 slot. * fix: drive native review questions and preserve current plans Use the native single-choice keyboard protocol and current terminal viewport, with per-question navigation inside packets and completed-call coverage. Keep permissions, multi-select menus, and Submit controls distinct. Send Autoplan reviewers the amended implementation plan, keep its review record separate, and supply retained application contracts in the chain fixture. Clarify individual DevEx decisions and complete CEO fix options; use one active plan destination for the section-loading report. * fix: preserve complete plan-review decisions * fix: recognize native plan dialogs and reviewer controls * fix: preserve review decisions and phase completion * fix: recognize completed reviews without losing findings * fix: preserve review continuity and native eval completion * test: fix native review completion and eval retry isolation * test: handle native review menus and complete eval fixtures * test: fix native review setup, completion, and isolation failures * test: limit native skill discovery to runtime assets * fix: bind Autoplan reviews to full ordered phase inputs * test: fix planning eval routing, counting, and timeout handling * chore: advance queued release to v1.84.0.0 * fix: preserve complete review inputs and planning decisions * fix: reconcile review approvals and preserve phase obligations * fix: preserve review obligations and unblock eval permissions Carry recorded Autoplan requirements into blind phase inputs, require Eng review approvals before exit, and exercise combined asynchronous flows in CEO reviews. Correct native finding and handoff classification and unblock repeated report edits using scoped request identities. * fix: retain plan requirements and complete native review dialogs * fix: complete native review prompts and retain plan references * fix: preserve review inputs and classify native eval evidence * fix: check competing completion orders in CEO reviews * fix: recognize review decisions and require phase methodology Require the current phase methodology before Autoplan snapshots. Correct substantive decision, closed handoff, and cache-finding classification, and honor the recommended implementation approach in native review dialogs. Add captured-transcript regressions without changing review thresholds, provider models, retries, or deadlines. * test: bind native review decisions and close completed handoffs * fix: complete review dialogs and verify methodology delivery * fix: preserve review evidence and unblock native eval prompts * fix: handle native review question completions * fix: recognize native review narration and controls * fix: count native review decisions and isolate eval fixtures * test: verify seeded review coverage and current artifact permissions * test: isolate model and brain-aware skill renders * fix: repair native workflow evaluation and clarify review steps * fix: stabilize workflow eval evidence and review guidance * test: repair native workflow observation and fixture isolation * fix: recognize completed workflow evidence and owned skill reads * test: repair seeded workflow delivery and completion evidence * test: recognize current review evidence across native forms * test: handle native review variants and permission redraws * fix: honor review preferences and recognize native eval evidence * test: recognize completed review decisions and queued permissions * test: match current review contracts and partial-line edits * test: recognize completed workflow evidence and bounded human waits * fix: preserve review entry gates and native eval interactions * fix: recognize native workflow evidence and preserve review gates * test: recognize current review evidence and preconfigure workflow fixtures * test: recognize completed review findings and scoped artifact permissions * fix: stabilize native workflow review and permission evidence * fix: recognize current review evidence and scoped edit confirmations Clarify Design and engineering review entry instructions and Design scoring. Recognize required legacy coverage and public Autoplan completion recaps. Bind the pending Edit confirmation to its exact file, ordered digest, and one-request approval when a preceding command display remains visible. Keep reviews within their existing size limits and preserve scope gates when extracting workflow fixtures from either supported preamble header. Keep failure outcomes, review thresholds, provider choices, and eval budgets. * fix: recover review workflow progress and eval evidence * fix: recognize valid review evidence and scope selection * test: fix review evidence parsing and repeated artifact prompts * test: recognize valid review decisions and pending native cards * fix(plan-eng-review): keep final navigation consistent with approved tasks * test: recognize valid review evidence and bind legacy diff requests * fix: stabilize review eval evidence and harness repair guidance * docs: update project documentation for v1.85.0.0 Co-Authored-By: OpenAI Codex <noreply@openai.com> * test: fix Windows CI fixtures and credential scan Rebase captured JSON values and filesystem evidence using the appropriate path convention. Compile native fake CLIs on Windows and synchronize pipe holder readiness, with cleanup retained when assertions fail. Assemble synthetic credential fixtures at runtime so the added-line scan keeps enforcing the same gate without flagging its own rejection controls. Discover generated skills directly for the empty-find regression check, avoiding a recursive scan through saved evaluation artifacts and dependencies. * fix: preserve source renders on Windows Compare canonical generator paths using native separators so an output sidecar pointing at the source cannot overwrite its skill or metadata. Keep the regression fixture isolated from the real checkout and expose freshness diagnostics before asserting subprocess status. Detach Windows drain-test pipe holders from the fake provider's automatic child cleanup while preserving the enclosing runner job and its assertions. * fix: clarify outside review fallback and CEO decisions Render one applicable own-harness fallback path and retain native review, disabled policy, and missing-coverage semantics. Align report field names and mode labels, and make the existing per-cut scope approval explicit. Regenerate skill outputs and keep the workflow judge's model, thresholds, and retry policy unchanged. * chore: move release to free version slot (v1.86.0.0) PR #2852 now claims v1.85.0.0. Align the release metadata and rename migration so upgrades from that version still receive it. Co-Authored-By: OpenAI Codex <noreply@openai.com> * fix: include engineering review prerequisites and restore branch context * fix: recognize coverage diagrams and clarify design review instructions * fix: preserve file identities and join Windows test processes --------- Co-authored-by: OpenAI Codex <noreply@openai.com>
1036 lines
68 KiB
Markdown
1036 lines
68 KiB
Markdown
<!-- AUTO-GENERATED from review-sections.md.tmpl — do not edit directly -->
|
||
<!-- Regenerate: bun run gen:skill-docs -->
|
||
## Review Sections (after scope is agreed)
|
||
|
||
**Anti-skip rule:** Never condense, abbreviate, or skip any review section (1-4) regardless of plan type (strategy, spec, code, infra). Every section in this skill exists for a reason. "This is a strategy doc so implementation sections don't apply" is always wrong — implementation details are where strategy breaks down. If a section genuinely has zero findings, say "No issues found" and move on — but you must evaluate it.
|
||
|
||
**Anti-shortcut clause:** The plan file is the OUTPUT of the interactive review, not a substitute for it. Writing every finding into one plan write and calling ExitPlanMode without firing AskUserQuestion is the precise failure mode of the May 2026 transcript bug — the model explored, found issues, and dumped them into a deliverable rather than walking the user through them. If you have ANY non-trivial finding in any review section, the path from finding to ExitPlanMode goes THROUGH AskUserQuestion. Zero findings in every section is the only path to ExitPlanMode that bypasses AskUserQuestion. If you find yourself wanting to write a plan with findings before asking, stop and call AskUserQuestion now — that's the bug, recognize it.
|
||
|
||
## Prior Learnings
|
||
|
||
Search for relevant learnings from previous sessions:
|
||
|
||
```bash
|
||
_CROSS_PROJ=$(~/.claude/skills/gstack/bin/gstack-config get cross_project_learnings 2>/dev/null || echo "unset")
|
||
echo "CROSS_PROJECT: $_CROSS_PROJ"
|
||
if [ "$_CROSS_PROJ" = "true" ]; then
|
||
~/.claude/skills/gstack/bin/gstack-learnings-search --limit 10 --cross-project 2>/dev/null || true
|
||
else
|
||
~/.claude/skills/gstack/bin/gstack-learnings-search --limit 10 2>/dev/null || true
|
||
fi
|
||
```
|
||
|
||
If `CROSS_PROJECT` is `unset` (first time): Use AskUserQuestion:
|
||
|
||
> gstack can search learnings from your other projects on this machine to find
|
||
> patterns that might apply here. This stays local (no data leaves your machine).
|
||
> Recommended for solo developers. Skip if you work on multiple client codebases
|
||
> where cross-contamination would be a concern.
|
||
|
||
Options:
|
||
- A) Enable cross-project learnings (recommended)
|
||
- B) Keep learnings project-scoped only
|
||
|
||
If A: run `~/.claude/skills/gstack/bin/gstack-config set cross_project_learnings true`
|
||
If B: run `~/.claude/skills/gstack/bin/gstack-config set cross_project_learnings false`
|
||
|
||
Then re-run the search with the appropriate flag.
|
||
|
||
If learnings are found, incorporate them into your analysis. When a review finding
|
||
matches a past learning, display:
|
||
|
||
**"Prior learning applied: [key] (confidence N/10, from [date])"**
|
||
|
||
This makes the compounding visible. The user should see that gstack is getting
|
||
smarter on their codebase over time.
|
||
|
||
## Retrospective learning
|
||
Check the git log for this branch. If there are prior commits suggesting a previous review cycle (e.g., review-driven refactors, reverted changes), note what was changed and whether the current plan touches the same areas. Be more aggressive reviewing areas that were previously problematic.
|
||
|
||
**Present complete remedies.** Before asking about one issue, include the
|
||
validation and failure handling needed to make that remedy work in its options.
|
||
Record the individually approved remedy in the plan. Later sections verify and
|
||
reference that decision; they do not ask again for work already included in it.
|
||
A new failure mode or tradeoff still requires its own decision. Scope approval
|
||
alone does not approve individual findings, and approving one remedy does not
|
||
approve independent issues or new TODOs. Keep those approvals separate.
|
||
|
||
**Plan-review evidence:** Apply the calibration gate below before Section 1. For proposed work, quote the motivating plan requirement (plan file:line); verify it against existing interfaces where applicable. Do not require nonexistent future code or describe a proposed regression as an observed one. Code-specific examples apply when critiquing existing code. Put suppressed findings in a `Suppressed findings` appendix to the review report.
|
||
|
||
## Confidence Calibration
|
||
|
||
Every finding MUST include a confidence score (1-10):
|
||
|
||
| Score | Meaning | Display rule |
|
||
|-------|---------|-------------|
|
||
| 9-10 | Verified by reading specific code. Concrete bug or exploit demonstrated. | Show normally |
|
||
| 7-8 | High confidence pattern match. Very likely correct. | Show normally |
|
||
| 5-6 | Moderate. Could be a false positive. | Show with caveat: "Medium confidence, verify this is actually an issue" |
|
||
| 3-4 | Low confidence. Pattern is suspicious but may be fine. | Suppress from main report. Include in appendix only. |
|
||
| 1-2 | Speculation. | Only report if severity would be P0. |
|
||
|
||
**Finding format:**
|
||
|
||
\`[SEVERITY] (confidence: N/10) file:line — description\`
|
||
|
||
Example:
|
||
\`[P1] (confidence: 9/10) app/models/user.rb:42 — SQL injection via string interpolation in where clause\`
|
||
\`[P2] (confidence: 5/10) app/controllers/api/v1/users_controller.rb:18 — Possible N+1 query, verify with production logs\`
|
||
|
||
### Pre-emit verification gate (#1539 — kills the "field doesn't exist" FP class)
|
||
|
||
Before any finding is promoted to the report, the gate requires:
|
||
|
||
1. **Quote the specific code line that motivates the finding** — file:line plus
|
||
the verbatim text of the line(s) that triggered it. If the finding is "field
|
||
X doesn't exist on model Y", quote the lines of class Y where the field
|
||
would live. If "dict.get() might return None", quote the dict initialization.
|
||
If "race condition between A and B", quote both A and B.
|
||
|
||
2. **If you cannot quote the motivating line(s), the finding is unverified.**
|
||
Force its confidence to 4-5 (suppressed from the main report). It still goes
|
||
into the appendix so reviewers can audit calibration, but the user does NOT
|
||
see it in the critical-pass output. Do not work around this by inventing
|
||
speculative confidence 7+ — that defeats the gate.
|
||
|
||
**Framework-meta nudge:** When the symbol is generated by a framework
|
||
metaclass, descriptor, ORM Meta inner-class, or migration history (Django
|
||
`Meta`, Rails `has_many`/`scope`, SQLAlchemy `relationship`/`Column`,
|
||
TypeORM decorators, Sequelize `init`/`belongsTo`, Prisma generated client),
|
||
quote the meta-construct (the `Meta` block, the migration, the decorator,
|
||
the schema file) instead of expecting the literal name in the class body.
|
||
The verification is "I read the source that creates this symbol", not "I
|
||
grep'd for the name and didn't find it." Deeper framework-aware verification
|
||
(model introspection, migration-history-aware checks, ORM dialect detection)
|
||
is deliberately out of scope for the lighter gate — see the deferred
|
||
`~/.gstack-dev/plans/1539-framework-aware-review.md` design doc.
|
||
|
||
The FP classes the gate kills (measured against Django Sprint 2.5 #1539):
|
||
|
||
| FP class | Why the gate catches it |
|
||
|---|---|
|
||
| "field doesn't exist on model" | Requires quoting the model class body or Meta; the field's absence becomes obvious |
|
||
| "dict.get() might be None" | Requires quoting the dict initialization (e.g. Django form's `cleaned_data` is `{}`-initialized) |
|
||
| "save() might lose fields" | Requires quoting the ORM signature or model definition |
|
||
| "update_fields might miss X" | Requires quoting the field set; if X doesn't exist, the FP is self-evident |
|
||
|
||
**Calibration learning:** If you report a finding with confidence < 7 and the user
|
||
confirms it IS a real issue, that is a calibration event. Your initial confidence was
|
||
too low. Log the corrected pattern as a learning so future reviews catch it with
|
||
higher confidence.
|
||
|
||
## Formatting rules
|
||
* NUMBER issues (1, 2, 3...) and LETTERS for options (A, B, C...).
|
||
* Label with NUMBER + LETTER (e.g., "3A", "3B"). These issue IDs are separate from the preamble's `D<N>` question sequence; cite the issue ID in the question title.
|
||
* Keep each option label to one sentence; include the preamble's full reasoning and pros/cons below it.
|
||
* Follow the per-issue approval rule in **CRITICAL RULE — How to ask questions**: wait for each finding's answer; zero-finding sections proceed as specified there.
|
||
|
||
### 1. Architecture review
|
||
Evaluate:
|
||
* Overall system design and component boundaries.
|
||
* Dependency graph and coupling concerns.
|
||
* Data flow patterns and potential bottlenecks.
|
||
* Scaling characteristics and single points of failure.
|
||
* Security architecture (auth, data access, API boundaries).
|
||
* Whether key flows deserve ASCII diagrams in the plan or in code comments.
|
||
* For each new codepath or integration point, describe one realistic production failure scenario and whether the plan accounts for it.
|
||
* **Distribution architecture:** If this introduces a new artifact (binary, package, container), how does it get built, published, and updated? Is the CI/CD pipeline part of the plan or deferred?
|
||
|
||
For each issue found in this section, call AskUserQuestion individually. One issue per call. Present options, state your recommendation, explain WHY. Do NOT batch multiple issues into one AskUserQuestion. Use the preamble's AskUserQuestion Format section. The AskUserQuestion call is a tool_use, not prose — call the tool directly.
|
||
|
||
**STOP.** Do NOT proceed to the next review section, edit the plan file with the proposed fix, or call ExitPlanMode until the user responds. An issue with an "obvious fix" is still an issue and still needs explicit user approval before it lands in the plan. Loading the AskUserQuestion schema via ToolSearch and then writing the recommendation as chat prose is the failure mode this gate exists to prevent.
|
||
|
||
### 2. Code quality review
|
||
Evaluate:
|
||
* Code organization and module structure.
|
||
* DRY violations—be aggressive here.
|
||
* Error handling patterns and missing edge cases (call these out explicitly).
|
||
* Technical debt hotspots.
|
||
* Areas that are over-engineered or under-engineered relative to my preferences.
|
||
* Existing ASCII diagrams in touched files — are they still accurate after this change?
|
||
|
||
For each issue found in this section, call AskUserQuestion individually. One issue per call. Present options, state your recommendation, explain WHY. Do NOT batch multiple issues into one AskUserQuestion. Use the preamble's AskUserQuestion Format section. The AskUserQuestion call is a tool_use, not prose — call the tool directly.
|
||
|
||
**STOP.** Do NOT proceed to the next review section, edit the plan file with the proposed fix, or call ExitPlanMode until the user responds. An issue with an "obvious fix" is still an issue and still needs explicit user approval before it lands in the plan. Loading the AskUserQuestion schema via ToolSearch and then writing the recommendation as chat prose is the failure mode this gate exists to prevent.
|
||
|
||
### 3. Test review
|
||
|
||
100% coverage is the goal. Evaluate every codepath in the plan and ensure the plan includes tests for each one. If the plan is missing tests, add them — the plan should be complete enough that implementation includes full test coverage from the start.
|
||
|
||
### Test Framework Detection
|
||
|
||
Before analyzing coverage, detect the project's test framework:
|
||
|
||
1. **Read CLAUDE.md** — look for a `## Testing` section with test command and framework name. If found, use that as the authoritative source.
|
||
2. **If CLAUDE.md has no testing section, auto-detect:**
|
||
|
||
```bash
|
||
setopt +o nomatch 2>/dev/null || true # zsh compat
|
||
# Detect project runtime (markers are evidence, not commands to run blind)
|
||
[ -f manage.py ] && echo "RUNTIME:python FRAMEWORK:django"
|
||
{ [ -f pyproject.toml ] || [ -f pytest.ini ] || [ -f tox.ini ] || [ -f setup.cfg ] || [ -f requirements.txt ]; } && echo "RUNTIME:python"
|
||
[ -f Gemfile ] || [ -f Rakefile ] || [ -f .rspec ] && echo "RUNTIME:ruby"
|
||
[ -f package.json ] && echo "RUNTIME:node"
|
||
[ -f go.mod ] && echo "RUNTIME:go"
|
||
[ -f Cargo.toml ] && echo "RUNTIME:rust"
|
||
[ -f pom.xml ] && echo "RUNTIME:jvm BUILD:maven"
|
||
{ [ -f build.gradle ] || [ -f build.gradle.kts ]; } && echo "RUNTIME:jvm BUILD:gradle"
|
||
# Check for existing test infrastructure — config files, scripts, AND test files
|
||
ls jest.config.* vitest.config.* playwright.config.* cypress.config.* .rspec pytest.ini tox.ini phpunit.xml 2>/dev/null
|
||
[ -f package.json ] && grep -q '"test"[[:space:]]*:' package.json && echo "SCRIPT:package.json test"
|
||
[ -f Makefile ] && grep -qE '^(test|check):' Makefile && echo "TARGET:make test"
|
||
git ls-files | grep -cE '(^|/)(tests?|spec|__tests__)/|(^|/)tests?\.py$|(^|/)test_[^/]+\.py$|_test\.(go|py|rb|ts|js|exs)$|\.(test|spec)\.[jt]sx?$|_spec\.rb$|Test\.(java|kt)$' | sed 's/^/TESTFILES:/'
|
||
```
|
||
|
||
3. **If no framework detected:** still produce the coverage diagram, but skip test generation.
|
||
|
||
**Step 1. Trace every codepath in the plan:**
|
||
|
||
Read the plan document. For each new feature, service, endpoint, or component described, trace how data will flow through the code — don't just list planned functions, actually follow the planned execution:
|
||
|
||
1. **Read the plan.** For each planned component, understand what it does and how it connects to existing code.
|
||
2. **Trace data flow.** Starting from each entry point (route handler, exported function, event listener, component render), follow the data through every branch:
|
||
- Where does input come from? (request params, props, database, API call)
|
||
- What transforms it? (validation, mapping, computation)
|
||
- Where does it go? (database write, API response, rendered output, side effect)
|
||
- What can go wrong at each step? (null/undefined, invalid input, network failure, empty collection)
|
||
3. **Diagram the execution.** For each changed file, draw an ASCII diagram showing:
|
||
- Every function/method that was added or modified
|
||
- Every conditional branch (if/else, switch, ternary, guard clause, early return)
|
||
- Every error path (try/catch, rescue, error boundary, fallback)
|
||
- Every call to another function (trace into it — does IT have untested branches?)
|
||
- Every edge: what happens with null input? Empty array? Invalid type?
|
||
|
||
This is the critical step — you're building a map of every line of code that can execute differently based on input. Every branch in this diagram needs a test.
|
||
|
||
**Step 2. Map user flows, interactions, and error states:**
|
||
|
||
Code coverage isn't enough — you need to cover how real users interact with the changed code. For each changed feature, think through:
|
||
|
||
- **User flows:** What sequence of actions does a user take that touches this code? Map the full journey (e.g., "user clicks 'Pay' → form validates → API call → success/failure screen"). Each step in the journey needs a test.
|
||
- **Interaction edge cases:** What happens when the user does something unexpected?
|
||
- Double-click/rapid resubmit
|
||
- Navigate away mid-operation (back button, close tab, click another link)
|
||
- Submit with stale data (page sat open for 30 minutes, session expired)
|
||
- Slow connection (API takes 10 seconds — what does the user see?)
|
||
- Concurrent actions (two tabs, same form)
|
||
- **Error states the user can see:** For every error the code handles, what does the user actually experience?
|
||
- Is there a clear error message or a silent failure?
|
||
- Can the user recover (retry, go back, fix input) or are they stuck?
|
||
- What happens with no network? With a 500 from the API? With invalid data from the server?
|
||
- **Empty/zero/boundary states:** What does the UI show with zero results? With 10,000 results? With a single character input? With maximum-length input?
|
||
|
||
Add these to your diagram alongside the code branches. A user flow with no test is just as much a gap as an untested if/else.
|
||
|
||
**Step 3. Check each branch against existing tests:**
|
||
|
||
Go through your diagram branch by branch — both code paths AND user flows. For each one, search for a test that exercises it:
|
||
- Function `processPayment()` → look for `billing.test.ts`, `billing.spec.ts`, `test/billing_test.rb`
|
||
- An if/else → look for tests covering BOTH the true AND false path
|
||
- An error handler → look for a test that triggers that specific error condition
|
||
- A call to `helperFn()` that has its own branches → those branches need tests too
|
||
- A user flow → look for an integration or E2E test that walks through the journey
|
||
- An interaction edge case → look for a test that simulates the unexpected action
|
||
|
||
Quality scoring rubric:
|
||
- ★★★ Tests behavior with edge cases AND error paths
|
||
- ★★ Tests correct behavior, happy path only
|
||
- ★ Smoke test / existence check / trivial assertion (e.g., "it renders", "it doesn't throw")
|
||
|
||
### E2E Test Decision Matrix
|
||
|
||
When checking each branch, also determine whether a unit test or E2E/integration test is the right tool:
|
||
|
||
**RECOMMEND E2E (mark as [→E2E] in the diagram):**
|
||
- Common user flow spanning 3+ components/services (e.g., signup → verify email → first login)
|
||
- Integration point where mocking hides real failures (e.g., API → queue → worker → DB)
|
||
- Auth/payment/data-destruction flows — too important to trust unit tests alone
|
||
|
||
**RECOMMEND EVAL (mark as [→EVAL] in the diagram):**
|
||
- Critical LLM call that needs a quality eval (e.g., prompt change → test output still meets quality bar)
|
||
- Changes to prompt templates, system instructions, or tool definitions
|
||
|
||
**STICK WITH UNIT TESTS:**
|
||
- Pure function with clear inputs/outputs
|
||
- Internal helper with no side effects
|
||
- Edge case of a single function (null input, empty array)
|
||
- Obscure/rare flow that isn't customer-facing
|
||
|
||
### REGRESSION RULE (mandatory)
|
||
|
||
**IRON RULE:** When the coverage audit identifies a REGRESSION — code that previously worked but the diff broke — a regression test is added to the plan as a critical requirement. No AskUserQuestion. No skipping. Regressions are the highest-priority test because they prove something broke.
|
||
|
||
A regression is when:
|
||
- The diff modifies existing behavior (not new code)
|
||
- The existing test suite (if any) doesn't cover the changed path
|
||
- The change introduces a new failure mode for existing callers
|
||
|
||
When uncertain whether a change is a regression, err on the side of writing the test.
|
||
|
||
**Step 4. Output ASCII coverage diagram:**
|
||
|
||
Include BOTH code paths and user flows in the same diagram. Mark E2E-worthy and eval-worthy paths:
|
||
|
||
```
|
||
CODE PATHS USER FLOWS
|
||
[+] src/services/billing.ts [+] Payment checkout
|
||
├── processPayment() ├── [★★★ TESTED] Complete purchase — checkout.e2e.ts:15
|
||
│ ├── [★★★ TESTED] happy + declined + timeout ├── [GAP] [→E2E] Double-click submit
|
||
│ ├── [GAP] Network timeout └── [GAP] Navigate away mid-payment
|
||
│ └── [GAP] Invalid currency
|
||
└── refundPayment() [+] Error states
|
||
├── [★★ TESTED] Full refund — :89 ├── [★★ TESTED] Card declined message
|
||
└── [★ TESTED] Partial (non-throw only) — :101 └── [GAP] Network timeout UX
|
||
|
||
LLM integration: [GAP] [→EVAL] Prompt template change — needs eval test
|
||
|
||
COVERAGE: 5/13 paths tested (38%) | Code paths: 3/5 (60%) | User flows: 2/8 (25%)
|
||
QUALITY: ★★★:2 ★★:2 ★:1 | GAPS: 8 (2 E2E, 1 eval)
|
||
```
|
||
|
||
Legend: ★★★ behavior + edge + error | ★★ happy path | ★ smoke check
|
||
[→E2E] = needs integration test | [→EVAL] = needs LLM eval
|
||
|
||
**Fast path:** All paths covered → "Test review: All new code paths have test coverage ✓" Continue.
|
||
|
||
**Step 5. Add missing tests to the plan:**
|
||
|
||
For each GAP identified in the diagram, add a test requirement to the plan. Be specific:
|
||
- What test file to create (match existing naming conventions)
|
||
- What the test should assert (specific inputs → expected outputs/behavior)
|
||
- Whether it's a unit test, E2E test, or eval (use the decision matrix)
|
||
- For regressions: flag as **CRITICAL** and explain what broke
|
||
|
||
The plan should be complete enough that when implementation begins, every test is written alongside the feature code — not deferred to a follow-up.
|
||
|
||
### Test Plan Artifact
|
||
|
||
After producing the coverage diagram, write a test plan artifact to the project directory so `/qa` and `/qa-only` can consume it as primary test input:
|
||
|
||
```bash
|
||
eval "$(~/.claude/skills/gstack/bin/gstack-slug 2>/dev/null)" && mkdir -p ~/.gstack/projects/$SLUG # sets SLUG and BRANCH
|
||
USER=$(whoami)
|
||
DATETIME=$(date +%Y%m%d-%H%M%S)
|
||
```
|
||
|
||
Write to `~/.gstack/projects/{slug}/{user}-{branch}-eng-review-test-plan-{datetime}.md`:
|
||
|
||
```markdown
|
||
# Test Plan
|
||
Generated by /plan-eng-review on {date}
|
||
Branch: {branch}
|
||
Repo: {owner/repo}
|
||
|
||
## Affected Pages/Routes
|
||
- {URL path} — {what to test and why}
|
||
|
||
## Key Interactions to Verify
|
||
- {interaction description} on {page}
|
||
|
||
## Edge Cases
|
||
- {edge case} on {page}
|
||
|
||
## Critical Paths
|
||
- {end-to-end flow that must work}
|
||
```
|
||
|
||
This file is consumed by `/qa` and `/qa-only` as primary test input. Include only the information that helps a QA tester know **what to test and where** — not implementation details.
|
||
|
||
For LLM/prompt changes: check the "Prompt/LLM changes" file patterns listed in CLAUDE.md. If this plan touches ANY of those patterns, state which eval suites must be run, which cases should be added, and what baselines to compare against. Then use AskUserQuestion to confirm the eval scope with the user.
|
||
|
||
For each issue found in this section, call AskUserQuestion individually. One issue per call. Present options, state your recommendation, explain WHY. Do NOT batch multiple issues into one AskUserQuestion. Use the preamble's AskUserQuestion Format section. The AskUserQuestion call is a tool_use, not prose — call the tool directly.
|
||
|
||
**STOP.** Do NOT proceed to the next review section, edit the plan file with the proposed fix, or call ExitPlanMode until the user responds. An issue with an "obvious fix" is still an issue and still needs explicit user approval before it lands in the plan. Loading the AskUserQuestion schema via ToolSearch and then writing the recommendation as chat prose is the failure mode this gate exists to prevent.
|
||
|
||
### 4. Performance review
|
||
Evaluate:
|
||
* N+1 queries and database access patterns.
|
||
* Memory-usage concerns.
|
||
* Caching opportunities.
|
||
* Slow or high-complexity code paths.
|
||
|
||
For each issue found in this section, call AskUserQuestion individually. One issue per call. Present options, state your recommendation, explain WHY. Do NOT batch multiple issues into one AskUserQuestion. Use the preamble's AskUserQuestion Format section. The AskUserQuestion call is a tool_use, not prose — call the tool directly.
|
||
|
||
**STOP.** Do NOT proceed to the next review section, edit the plan file with the proposed fix, or call ExitPlanMode until the user responds. An issue with an "obvious fix" is still an issue and still needs explicit user approval before it lands in the plan. Loading the AskUserQuestion schema via ToolSearch and then writing the recommendation as chat prose is the failure mode this gate exists to prevent.
|
||
|
||
## Outside Voice — Independent Plan Challenge (default-on)
|
||
|
||
After all review sections are complete, run an independent second opinion from a
|
||
different AI system automatically — it is a standard part of plan review, not an
|
||
opt-in. Two models agreeing on a plan is stronger signal than one model's thorough
|
||
review. The user turns this off only by asking explicitly
|
||
(`gstack-config set codex_reviews disabled`).
|
||
|
||
**Preflight — decide whether and how the outside voice runs:**
|
||
|
||
```bash
|
||
|
||
# Codex preflight: one block (functions sourced here don't persist to later blocks).
|
||
_TEL=$(~/.claude/skills/gstack/bin/gstack-config get telemetry 2>/dev/null || echo off)
|
||
_CODEX_CFG=$(~/.claude/skills/gstack/bin/gstack-config get codex_reviews 2>/dev/null || echo enabled)
|
||
source ~/.claude/skills/gstack/bin/gstack-codex-probe 2>/dev/null || true
|
||
if [ "$_CODEX_CFG" = "disabled" ]; then
|
||
_CODEX_MODE="disabled"
|
||
# Running-under-Codex presence probe (#2519): a live Codex session exports
|
||
# CODEX_THREAD_ID / CODEX_SANDBOX into every shell it spawns (verified
|
||
# against a live `codex exec 'env | grep -i codex'` capture, codex 0.147.0).
|
||
# Nested codex spawns from inside a Codex host multiply token burn
|
||
# (observed: one /review = 15M tokens). A stale own-harness artifact must stop.
|
||
elif { [ -n "${CODEX_THREAD_ID:-}" ] || [ -n "${CODEX_SANDBOX:-}" ] || [ "${GSTACK_ACTIVE_HOST:-}" = codex ]; }; then
|
||
_CODEX_MODE="under_codex"
|
||
elif ! command -v codex >/dev/null 2>&1; then
|
||
_CODEX_MODE="not_installed"; _gstack_codex_log_event "codex_cli_missing" 2>/dev/null || true
|
||
elif ! _gstack_codex_auth_probe >/dev/null 2>&1; then
|
||
_CODEX_MODE="not_authed"; _gstack_codex_log_event "codex_auth_failed" 2>/dev/null || true
|
||
else
|
||
# Capture the probe's code: 2 means the CLI cannot execute at all, which is a
|
||
# different problem (and a different fix) from a model the account can't use.
|
||
_gstack_codex_model_probe; _CODEX_MP=$?
|
||
if [ "$_CODEX_MP" -eq 2 ]; then
|
||
_CODEX_MODE="broken_install"
|
||
elif [ "$_CODEX_MP" -ne 0 ]; then
|
||
_CODEX_MODE="model_unusable"
|
||
else
|
||
_CODEX_MODE="ready"; _gstack_codex_version_check 2>/dev/null || true
|
||
fi
|
||
fi
|
||
echo "CODEX_MODE: $_CODEX_MODE"
|
||
```
|
||
|
||
Branch on the echoed `CODEX_MODE`:
|
||
- **`disabled`** — the user turned Codex reviews off (`codex_reviews=disabled`). Skip this section entirely; do NOT fall back to a Claude subagent — disabled means no extra review step. Print: "Codex review skipped (codex_reviews disabled). Re-enable: `gstack-config set codex_reviews enabled`."
|
||
- **`not_installed`** — Codex CLI absent. Print: "Codex not installed — falling back to a Claude subagent (fresh context, but the same harness; model identity is unknown). Install Codex for an actual outside-model read: `npm install -g @openai/codex`." Fall back to the Claude subagent path.
|
||
- **`under_codex`** — stale artifact selected its own harness. Print: "Codex outside review unavailable: harness mismatch; no outside process started. Missing coverage. Repair: setup --host codex." Skip the outside invocation and follow the workflow's native-review instructions below. Conflicting inherited harness markers are not grounds to guess another provider.
|
||
- **`not_authed`** — installed but no credentials. Print: "Codex installed but not authenticated — falling back to a Claude subagent (same harness; model identity is unknown). Run `codex login` or set `$CODEX_API_KEY`." Fall back to the Claude subagent path.
|
||
- **`broken_install`** — the CLI is on PATH but cannot execute (spawn ENOENT, non-executable binary, missing vendor payload). Print: "Codex is installed but its binary cannot run — Codex passes skipped. Reinstall: `npm install -g @openai/codex`." Relay the probe's HINT lines and fall back to the Claude subagent path. This state exists because a missing binary used to land in the model probe's fail-open bucket and report `ready`, so every Codex pass was skipped silently (#2742).
|
||
- **`model_unusable`** — authed but the account cannot use gstack's selected Codex model (#2477: HTTP 400 on every call). Relay the probe's HINT lines, tell the user the one-line fix (set `GSTACK_CODEX_MODEL=<supported-model>` or pass an explicit `-c model=...` override), and fall back to the Claude subagent path. The ~10s round trip is cached for 1h; timeouts fail open to `ready`.
|
||
- **`ready`** — run the Codex pass below.
|
||
|
||
**Disabled is a terminal branch for this section.** If the preflight prints
|
||
`CODEX_MODE: disabled`, persist `outside_status: disabled` with the guarded
|
||
command below, then continue directly to the workflow's required outputs after this section. Do not construct a challenge,
|
||
invoke an outside CLI, dispatch an Agent/Task fallback, or ask about outside findings.
|
||
The native plan review is already complete. A disabled review is an intentional
|
||
opt-out, not a provider failure that needs a replacement reviewer.
|
||
|
||
Run this guarded command before leaving the disabled branch. It starts a fresh
|
||
shell and re-reads the control; enabled workflows never append a disabled record.
|
||
If logging fails, report the persistence failure and retain the disabled opt-out.
|
||
|
||
```bash
|
||
|
||
_DISABLED_REVIEW_MODE=$("$HOME/.claude/skills/gstack/bin/gstack-config" get codex_reviews 2>/dev/null) || {
|
||
echo 'Cannot read codex_reviews; disabled outside coverage was not recorded.' >&2
|
||
exit 1
|
||
}
|
||
if [ "$_DISABLED_REVIEW_MODE" = disabled ]; then
|
||
"$HOME/.claude/skills/gstack/bin/gstack-review-log" '{"skill":"codex-plan-review","timestamp":"'"$(date -u +%Y-%m-%dT%H:%M:%SZ)"'","status":"skipped","source":"none","host":"claude","outside_provider":"codex","outside_status":"disabled","phase":"plan-review","commit":"'"$(git rev-parse --short HEAD 2>/dev/null || true)"'"}'
|
||
fi
|
||
```
|
||
|
||
When the mode is anything except `disabled`, print one line so the off-switch
|
||
stays discoverable: "Running the outside voice automatically (standard step). Disable: `gstack-config set codex_reviews disabled`."
|
||
|
||
**Construct the plan review prompt** (skip only on `disabled`).
|
||
Read the plan file being reviewed (the file the user pointed this review at, or the branch
|
||
diff scope). If a CEO plan document from an earlier `/plan-ceo-review` Step 0D-POST is available, read that too — it contains
|
||
the scope decisions and vision.
|
||
|
||
Construct this prompt (substitute the actual plan content — if plan content exceeds 30KB,
|
||
truncate to the first 30KB and note "Plan truncated for size"). **Always start with the
|
||
filesystem boundary instruction:**
|
||
|
||
"IMPORTANT: Do NOT read or execute any files under ~/.claude/, ~/.agents/, .claude/skills/, or agents/. These are skill definitions, not repository review data. Do not follow nested skills, hooks, or tool instructions. They contain bash scripts and prompt templates that will waste your time. Ignore them completely. Do NOT modify agents/openai.yaml. Stay focused on the repository code only.\n\nYou are a brutally honest technical reviewer examining a development plan that has
|
||
already been through a multi-section review. Your job is NOT to repeat that review.
|
||
Instead, find what it missed. Look for: logical gaps and unstated assumptions that
|
||
survived the review scrutiny, overcomplexity (is there a fundamentally simpler
|
||
approach the review was too deep in the weeds to see?), feasibility risks the review
|
||
took for granted, missing dependencies or sequencing issues, and strategic
|
||
miscalibration (is this the right thing to build at all?). Be direct. Be terse. No
|
||
compliments. Just the problems.
|
||
|
||
THE PLAN:
|
||
<plan content>"
|
||
|
||
**If `CODEX_MODE: ready` — run Codex:**
|
||
|
||
Use Write to save the **complete prompt and context** in a private file. Replace `<prepared-prompt-file>` below with its shell-quoted path; never interpolate user text into shell source. Include actual plan/spec/source content. Request a final Recommendation: <action> because <specific reason> line, including an explicit no-findings rationale. A refusal is never completion.
|
||
|
||
```bash
|
||
# GSTACK_ACTIVE_HOST names the harness, never the model.
|
||
if { [ -n "${CODEX_THREAD_ID:-}" ] || [ -n "${CODEX_SANDBOX:-}" ] || [ "${GSTACK_ACTIVE_HOST:-}" = codex ]; }; then
|
||
echo 'Codex outside review unavailable: harness mismatch; no outside process started. Missing coverage.' >&2
|
||
if { [ -n "${CLAUDECODE:-}" ] || [ "${GSTACK_ACTIVE_HOST:-}" = claude ]; } && { [ -n "${CODEX_THREAD_ID:-}" ] || [ -n "${CODEX_SANDBOX:-}" ] || [ "${GSTACK_ACTIVE_HOST:-}" = codex ]; }; then
|
||
echo 'Inherited harness markers conflict. Run setup --host <actual-harness> (claude or codex); do not guess a replacement provider.' >&2
|
||
else
|
||
echo 'Repair installed skills: run setup --host codex from your gstack checkout.' >&2
|
||
fi
|
||
exit 78
|
||
fi
|
||
|
||
_REPO_ROOT=$(git rev-parse --show-toplevel) || { echo 'ERROR: not in a git repo' >&2; exit 1; }
|
||
_OUTSIDE_TMP=$(mktemp -d "${TMPDIR:-/tmp}/gstack-outside.XXXXXXXX") || exit 1
|
||
trap 'rm -rf "$_OUTSIDE_TMP"' EXIT
|
||
_OUTSIDE_INPUT="$_OUTSIDE_TMP/prompt"
|
||
cat -- '<prepared-prompt-file>' >"$_OUTSIDE_INPUT" || exit 1
|
||
|
||
source "$HOME/.claude/skills/gstack/bin/gstack-codex-probe" || exit 1
|
||
_gstack_codex_timeout_wrapper 300 codex exec "$(cat "$_OUTSIDE_INPUT")" -C "$_REPO_ROOT" -s read-only -c "model=\"${GSTACK_CODEX_MODEL:-gpt-6-astra}\"" -c 'model_reasoning_effort="high"' -c 'web_search="cached"' < /dev/null >"$_OUTSIDE_TMP/text" 2>"$_OUTSIDE_TMP/stderr"
|
||
_OUTSIDE_EXIT=$?
|
||
# Preserve findings and partial output even when transport or validation fails.
|
||
cat "$_OUTSIDE_TMP/text"
|
||
|
||
cat "$_OUTSIDE_TMP/stderr" >&2
|
||
if [ "$_OUTSIDE_EXIT" -ne 0 ]; then
|
||
echo 'Codex outside review unavailable: execution failed; missing coverage. Check the provider diagnosis above.' >&2
|
||
exit "$_OUTSIDE_EXIT"
|
||
fi
|
||
bun "$HOME/.claude/skills/gstack/lib/outside-review-result.ts" review "$_OUTSIDE_TMP/text" || exit 1
|
||
|
||
echo 'OUTSIDE_STATUS: completed provider=codex host=claude'
|
||
```
|
||
|
||
Show the full response in a `tool-output` fence. Completed outside coverage requires successful execution and valid markers. Refusal, empty/malformed output, missing score/severity/completion markers, timeout, or CLI failure means `outside_status: unavailable`. Follow this caller's fallback; missing coverage is never clean/PASS. After success or failure, delete only your private prompt file; the invocation removes its scratch directory.
|
||
|
||
Present the full output verbatim:
|
||
|
||
```
|
||
CODEX SAYS (plan review — outside voice):
|
||
════════════════════════════════════════════════════════════
|
||
<full codex output, verbatim — do not truncate or summarize>
|
||
════════════════════════════════════════════════════════════
|
||
```
|
||
|
||
**Error handling:** All errors are non-blocking — the outside voice is informational.
|
||
- Auth failure (stderr contains "auth", "login", "unauthorized"): "Codex auth failed. Run \`codex login\` to authenticate." Fall back to the Claude subagent below.
|
||
- Timeout: "Codex timed out after 5 minutes." Fall back to the Claude subagent below.
|
||
- Empty response: "Codex returned no response." Fall back to the Claude subagent below.
|
||
|
||
**Native fallback — provider unavailable or execution failed, with reviews enabled:**
|
||
|
||
Immediately before dispatching, check the preflight result again. On
|
||
`CODEX_MODE: disabled`, finish this section with `outside_status: disabled`;
|
||
do not dispatch. Otherwise, use this fallback for missing/broken CLI, failed
|
||
authentication/model selection, a failed preflight, or a failed outside invocation.
|
||
The disabled branch never reaches this fallback.
|
||
On `CODEX_MODE: under_codex`, report the setup repair and
|
||
`outside_status: unavailable`, run no outside CLI, and use the native subagent below.
|
||
A native result never supplies outside coverage.
|
||
|
||
Dispatch via the Agent tool with `run_in_background: false` (subagents default to background since Claude Code v2.1.198; the findings must land before the workflow continues). The subagent has fresh context and no conversation bias — but it is the same harness; model identity stays unknown unless the runtime reports it; weigh its agreement accordingly.
|
||
Bound it the same way as Codex: cap the dispatch at a 5-minute timeout so "never blocking"
|
||
is also "never hanging."
|
||
|
||
Subagent prompt: same plan review prompt as above.
|
||
|
||
Present findings under an `OUTSIDE VOICE (Claude subagent):` header.
|
||
|
||
If the subagent fails or times out: "Outside voice unavailable. Continuing to outputs."
|
||
|
||
(On `CODEX_MODE: disabled` you already skipped this section per the preflight — do not reach here.)
|
||
|
||
**Cross-model tension:**
|
||
|
||
After presenting the outside voice findings, note any points where the outside voice
|
||
disagrees with the review findings from earlier sections. Flag these as:
|
||
|
||
```
|
||
CROSS-MODEL TENSION:
|
||
[Topic]: Review said X. Outside voice says Y. [Present both perspectives neutrally.
|
||
State what context you might be missing that would change the answer.]
|
||
```
|
||
|
||
**User Sovereignty:** Do NOT auto-incorporate outside voice recommendations into the plan.
|
||
Present each tension point to the user. The user decides. Cross-model agreement is a
|
||
strong signal — present it as such — but it is NOT permission to act. You may state
|
||
which argument you find more compelling, but you MUST NOT apply the change without
|
||
explicit user approval.
|
||
|
||
For each substantive tension point, use AskUserQuestion:
|
||
|
||
> "Cross-model disagreement on [topic]. The review found [X] but the outside voice
|
||
> argues [Y]. [One sentence on what context you might be missing.]"
|
||
>
|
||
> RECOMMENDATION: Choose [A or B] because [one-line reason explaining which argument
|
||
> is more compelling and why].
|
||
|
||
Score completeness only when the concrete remedies differ in coverage. Otherwise,
|
||
use the preamble's kind-not-coverage note; accepting, keeping, investigating, and
|
||
deferring do not themselves imply completeness scores.
|
||
|
||
Options:
|
||
- A) Accept the outside voice's recommendation (I'll apply this change)
|
||
- B) Keep the current approach (reject the outside voice)
|
||
- C) Investigate further before deciding
|
||
- D) Add to TODOS.md for later
|
||
|
||
Wait for the user's response. Do NOT default to accepting because you agree with the
|
||
outside voice. If the user chooses B, the current approach stands — do not re-argue.
|
||
|
||
If no tension points exist, note: "No cross-model tension — both reviewers agree."
|
||
|
||
**Persist the result:**
|
||
```bash
|
||
~/.claude/skills/gstack/bin/gstack-review-log '{"skill":"codex-plan-review","timestamp":"'"$(date -u +%Y-%m-%dT%H:%M:%SZ)"'","status":"STATUS","source":"SOURCE","host":"claude","outside_provider":"codex","outside_status":"OUTSIDE_STATUS","phase":"plan-review","commit":"'"$(git rev-parse --short HEAD)"'"}'
|
||
```
|
||
|
||
Substitute: STATUS = "clean" only if a reviewer completed and found no issues; "issues_found" if findings exist, or "unavailable" if neither reviewer completed. Never count missing coverage as a clean review.
|
||
For this phase (plan-review), retain the historical review-log skill identifier. Add `"host":"claude","outside_provider":"codex","outside_status":"completed|unavailable|disabled|skipped","phase":"plan-review"`. Record each attempted pass separately when outcomes differ. Use `source:"codex"` only for completed external CLI output, and `source:"in-host"` for a native pass. Historical `source:"claude"` continues to mean a native Claude subagent. CLI availability or a native fallback does not count as outside completion. Preserve reported modelUsage, including multiple models; unknown model identity stays unknown.
|
||
|
||
|
||
|
||
---
|
||
|
||
### Outside Voice Integration Rule
|
||
|
||
Outside voice findings are INFORMATIONAL until the user explicitly approves each one.
|
||
Do NOT incorporate outside voice recommendations into the plan without presenting each
|
||
finding via AskUserQuestion and getting explicit approval. This applies even when you
|
||
agree with the outside voice. Cross-model consensus is a strong signal — present it as
|
||
such — but the user makes the decision.
|
||
|
||
## CRITICAL RULE — How to ask questions
|
||
Follow the AskUserQuestion format from the Preamble above. Additional rules for plan reviews:
|
||
* **One issue = one AskUserQuestion call.** Never combine multiple issues into one question.
|
||
* Describe the problem concretely, with file and line references.
|
||
* Present 2-3 options, including "do nothing" where that's reasonable.
|
||
* For each option, specify in one line: effort (human: ~X / CC: ~Y), risk, and maintenance burden. If the complete option is only marginally more effort than the shortcut with CC, recommend the complete option.
|
||
* **Map the reasoning to my engineering preferences above.** One sentence connecting your recommendation to a specific preference (DRY, explicit > clever, minimal diff, etc.).
|
||
* Label with issue NUMBER + option LETTER (e.g., "3A", "3B").
|
||
* **Coverage vs kind:** for every per-issue AskUserQuestion you raise in this review, decide whether the options differ in coverage or in kind. If coverage (e.g., more tests vs fewer, complete error handling vs happy-path-only, full edge-case coverage vs shortcut), include `Completeness: N/10` on each option. If kind (e.g., architectural choice between two different systems, posture-over-posture, A/B/C where each is a different kind of thing), skip the score and add one line: `Note: options differ in kind, not coverage — no completeness score.` Do NOT fabricate scores on kind-differentiated questions — filler scores are worse than no score.
|
||
* **Zero findings:** if a section has zero findings, state "No issues, moving on" and proceed. Otherwise, use AskUserQuestion for each finding — a finding with an "obvious fix" is still a finding and still needs user approval before any change lands in the plan.
|
||
|
||
## Unresolved decisions
|
||
If the user does not respond to an AskUserQuestion or interrupts to move on, note which decisions were left unresolved. At the end of the review, list these as "Unresolved decisions that may bite you later" — never silently default to an option.
|
||
|
||
## Required outputs
|
||
|
||
Write the narrative outputs below to the active plan file, or to the review response when no plan file is present. Display the Completion Summary to the user and write separately named artifacts to their specified paths. Update TODOS.md only through its individual approval step below.
|
||
|
||
### "NOT in scope" section
|
||
Every plan review MUST produce a "NOT in scope" section listing work that was considered and explicitly deferred, with a one-line rationale for each item.
|
||
|
||
### "What already exists" section
|
||
List existing code/flows that already partially solve sub-problems in this plan, and whether the plan reuses them or unnecessarily rebuilds them.
|
||
|
||
### TODOS.md updates
|
||
After all review sections are complete, present each potential TODO as its own individual AskUserQuestion. Never batch TODOs — one per question. Never silently skip this step. Follow the format in `~/.claude/skills/gstack/review/TODOS-format.md`.
|
||
|
||
For each TODO, describe:
|
||
* **What:** One-line description of the work.
|
||
* **Why:** The concrete problem it solves or value it unlocks.
|
||
* **Pros:** What you gain by doing this work.
|
||
* **Cons:** Cost, complexity, or risks of doing it.
|
||
* **Context:** Enough detail that someone picking this up in 3 months understands the motivation, the current state, and where to start.
|
||
* **Depends on / blocked by:** Any prerequisites or ordering constraints.
|
||
|
||
Then present options: **A)** Add to TODOS.md **B)** Skip — not valuable enough **C)** Build it now in this PR instead of deferring.
|
||
|
||
Do NOT just append vague bullet points. A TODO without context is worse than no TODO — it creates false confidence that the idea was captured while actually losing the reasoning.
|
||
|
||
### Diagrams
|
||
The plan itself should use ASCII diagrams for any non-trivial data flow, state machine, or processing pipeline. Additionally, identify which files in the implementation should get inline ASCII diagram comments — particularly Models with complex state transitions, Services with multi-step pipelines, and Concerns with non-obvious mixin behavior.
|
||
|
||
### Failure modes
|
||
For each new codepath identified in the test review diagram, list one realistic way it could fail in production (timeout, nil reference, race condition, stale data, etc.) and whether:
|
||
1. A test covers that failure
|
||
2. Error handling exists for it
|
||
3. The user would see a clear error or a silent failure
|
||
|
||
If any failure mode has no test AND no error handling AND would be silent, flag it as a **critical gap**.
|
||
|
||
### Worktree parallelization strategy
|
||
|
||
Analyze the plan's implementation steps for parallel execution opportunities. This helps the user split work across git worktrees (via Claude Code's Agent tool with `isolation: "worktree"` or parallel workspaces).
|
||
|
||
**Skip if:** all steps touch the same primary module, or the plan has fewer than 2 independent workstreams. In that case, write: "Sequential implementation, no parallelization opportunity."
|
||
|
||
**Otherwise, produce:**
|
||
|
||
1. **Dependency table** — for each implementation step/workstream:
|
||
|
||
| Step | Modules touched | Depends on |
|
||
|------|----------------|------------|
|
||
| (step name) | (directories/modules, NOT specific files) | (other steps, or —) |
|
||
|
||
Work at the module/directory level, not file level. Plans describe intent ("add API endpoints"), not specific files. Module-level ("controllers/, models/") is reliable; file-level is guesswork.
|
||
|
||
2. **Parallel lanes** — group steps into lanes:
|
||
- Steps with no shared modules and no dependency go in separate lanes (parallel)
|
||
- Steps sharing a module directory go in the same lane (sequential)
|
||
- Steps depending on other steps go in later lanes
|
||
|
||
Format: `Lane A: step1 → step2 (sequential, shared models/)` / `Lane B: step3 (independent)`
|
||
|
||
3. **Execution order** — which lanes launch in parallel, which wait. Example: "Launch A + B in parallel worktrees. Merge both. Then C."
|
||
|
||
4. **Conflict flags** — if two parallel lanes touch the same module directory, flag it: "Lanes X and Y both touch module/ — potential merge conflict. Consider sequential execution or careful coordination."
|
||
|
||
## Implementation Tasks
|
||
|
||
Before closing this review, synthesize the findings above into a flat list of
|
||
build-actionable tasks. Each task derives from a specific finding — no padding.
|
||
Emit the markdown section AND write a JSONL artifact that `/autoplan` can
|
||
aggregate across phases.
|
||
|
||
### Markdown section (always emit)
|
||
|
||
```markdown
|
||
## Implementation Tasks
|
||
Synthesized from this review's findings. Each task derives from a specific
|
||
finding above. Run with Claude Code or Codex; checkbox as you ship.
|
||
|
||
- [ ] **T1 (P1, human: ~2h / CC: ~15min)** — <component> — <imperative title>
|
||
- Surfaced by: <section name> — <specific finding text or line reference>
|
||
- Files: <paths to touch>
|
||
- Verify: <test command or manual check>
|
||
- [ ] **T2 (P2, human: ~30min / CC: ~5min)** — ...
|
||
```
|
||
|
||
Rules:
|
||
- P1 blocks ship; P2 should land same branch; P3 is a follow-up TODO.
|
||
- If a finding produced no actionable task, do not invent one.
|
||
- If a section had zero findings, emit `_No new tasks from <section>._`
|
||
- Effort uses the AI-compression table from CLAUDE.md.
|
||
|
||
### JSONL artifact (always write, even if zero tasks)
|
||
|
||
`/autoplan` reads this file to aggregate across phases. Build each line with
|
||
`jq -nc` so titles and source findings containing quotes, newlines, or
|
||
backslashes serialize cleanly — never use hand-rolled `echo` / `printf`.
|
||
|
||
```bash
|
||
eval "$(~/.claude/skills/gstack/bin/gstack-slug 2>/dev/null)"
|
||
TASKS_DIR="${HOME}/.gstack/projects/${SLUG:-unknown}"
|
||
mkdir -p "$TASKS_DIR"
|
||
TASKS_FILE="$TASKS_DIR/tasks-eng-review-$(date +%Y%m%d-%H%M%S).jsonl"
|
||
COMMIT=$(git rev-parse HEAD 2>/dev/null || echo unknown)
|
||
BRANCH=$(git branch --show-current 2>/dev/null || echo unknown)
|
||
RUN_ID="$(date -u +%Y%m%dT%H%M%SZ)-$$"
|
||
|
||
# Repeat ONE jq invocation per task identified during this review.
|
||
# Substitute the placeholders inline with shell variables you set per task:
|
||
# TASK_ID (T1, T2, ...), PRIORITY (P1/P2/P3), COMPONENT, TITLE,
|
||
# SOURCE_FINDING, EFFORT_HUMAN, EFFORT_CC, FILES_JSON (a JSON array literal
|
||
# like '["browse/src/sanitize.ts","browse/src/server.ts"]').
|
||
jq -nc \
|
||
--arg phase 'eng-review' \
|
||
--arg run_id "$RUN_ID" \
|
||
--arg branch "$BRANCH" \
|
||
--arg commit "$COMMIT" \
|
||
--arg id "$TASK_ID" \
|
||
--arg priority "$PRIORITY" \
|
||
--arg component "$COMPONENT" \
|
||
--arg effort_human "$EFFORT_HUMAN" \
|
||
--arg effort_cc "$EFFORT_CC" \
|
||
--arg title "$TITLE" \
|
||
--arg source_finding "$SOURCE_FINDING" \
|
||
--argjson files "$FILES_JSON" \
|
||
'{phase:$phase, run_id:$run_id, branch:$branch, commit:$commit, id:$id, priority:$priority, component:$component, files:$files, effort_human:$effort_human, effort_cc:$effort_cc, title:$title, source_finding:$source_finding}' \
|
||
>> "$TASKS_FILE"
|
||
```
|
||
|
||
If `jq` is not installed, fall back to skipping the JSONL write and warn
|
||
the user to install jq for autoplan aggregation. Never hand-roll JSONL.
|
||
|
||
If zero tasks were identified in this review, still touch the JSONL file
|
||
(`: > "$TASKS_FILE"`) so the aggregator sees that the phase produced output
|
||
this run (an empty file means "ran, no findings" — distinct from "didn't run").
|
||
|
||
|
||
### Completion summary
|
||
At the end of the review, fill in and display this summary so the user can see all findings at a glance:
|
||
|
||
"Lake Score" counts complete options chosen out of decisions that compared a complete option with a shortcut; use `N/A` when there were no such decisions.
|
||
|
||
- Step 0: Scope Challenge — ___ (scope accepted as-is / scope reduced per recommendation)
|
||
- Architecture Review: ___ issues found
|
||
- Code Quality Review: ___ issues found
|
||
- Test Review: diagram produced, ___ gaps identified
|
||
- Performance Review: ___ issues found
|
||
- NOT in scope: written
|
||
- What already exists: written
|
||
- TODOS.md updates: ___ items proposed to user
|
||
- Failure modes: ___ critical gaps flagged
|
||
- Outside voice: ran (codex/claude) / skipped
|
||
- Parallelization: ___ lanes, ___ parallel / ___ sequential
|
||
- Lake Score: X/Y recommendations chose complete option
|
||
- Unresolved decisions: ___
|
||
|
||
## Review Log
|
||
|
||
After producing the Completion Summary above, persist the review result.
|
||
|
||
**PLAN MODE EXCEPTION — ALWAYS RUN:** This command writes review metadata to
|
||
`~/.gstack/` (user config directory, not project files). The skill preamble
|
||
already writes to `~/.gstack/sessions/` and `~/.gstack/analytics/` — this is
|
||
the same pattern. The review dashboard depends on this data. Skipping this
|
||
command breaks the review readiness dashboard in /ship.
|
||
|
||
```bash
|
||
~/.claude/skills/gstack/bin/gstack-review-log '{"skill":"plan-eng-review","timestamp":"TIMESTAMP","status":"STATUS","unresolved":N,"critical_gaps":N,"issues_found":N,"mode":"MODE","commit":"COMMIT"}'
|
||
~/.claude/skills/gstack/bin/gstack-decision-log '{"decision":"Eng review (MODE): ARCH_SUMMARY","rationale":"KEY_DECISION","scope":"branch","source":"skill","confidence":8}' 2>/dev/null || true
|
||
```
|
||
|
||
The second command records the architecture verdict as a durable cross-session decision (so a future session inherits the chosen approach and what was hardened, not just the count). Same `~/.gstack/` write pattern as review-log, non-interactive, best-effort (`|| true`). Substitute `ARCH_SUMMARY` (e.g. "N findings, all folded" or "M unresolved") and `KEY_DECISION` (the load-bearing architecture call from the report, one line — omit if the review found nothing durable).
|
||
|
||
Substitute values from the Completion Summary:
|
||
- **TIMESTAMP**: current ISO 8601 datetime
|
||
- **STATUS**: "clean" if 0 unresolved decisions AND 0 critical gaps; otherwise "issues_open"
|
||
- **unresolved**: number from "Unresolved decisions" count
|
||
- **critical_gaps**: number from "Failure modes: ___ critical gaps flagged"
|
||
- **issues_found**: total issues found across all review sections (Architecture + Code Quality + Performance + Test gaps)
|
||
- **MODE**: FULL_REVIEW / SCOPE_REDUCED
|
||
- **COMMIT**: output of `git rev-parse --short HEAD`
|
||
|
||
## Review Readiness Dashboard
|
||
|
||
After completing the review, read the review log and config to display the dashboard.
|
||
|
||
```bash
|
||
~/.claude/skills/gstack/bin/gstack-review-read
|
||
```
|
||
|
||
Render each record using its recorded host, source, outside_provider, outside_status, and phase. Historical source "claude" means a native Claude subagent; source "claude-code" means the external CLI. Never infer a historical provider from the current harness. Unknown model identity remains unknown. Missing/disabled/skipped outside coverage is distinct from native completion.
|
||
|
||
Parse the output. Find the most recent entry for each skill (plan-ceo-review, plan-eng-review, review, plan-design-review, design-review-lite, adversarial-review, codex-review, codex-plan-review). Ignore entries with timestamps older than 7 days. For the Eng Review row, show whichever is more recent between `review` (diff-scoped pre-landing review) and `plan-eng-review` (plan-stage architecture review). Append "(DIFF)" or "(PLAN)" to the status to distinguish. For the Adversarial row, show whichever is more recent between `adversarial-review` (new auto-scaled) and `codex-review` (legacy). For Design Review, show whichever is more recent between `plan-design-review` (full visual audit) and `design-review-lite` (code-level check). Append "(FULL)" or "(LITE)" to the status to distinguish. For the Outside Voice row, show the most recent `codex-plan-review` entry — this captures outside voices from both /plan-ceo-review and /plan-eng-review.
|
||
|
||
**Source attribution:** If the most recent entry for a skill has a \`"via"\` field, append it to the status label in parentheses. Examples: `plan-eng-review` with `via:"autoplan"` shows as "CLEAR (PLAN via /autoplan)". `review` with `via:"ship"` shows as "CLEAR (DIFF via /ship)". Entries without a `via` field show as "CLEAR (PLAN)" or "CLEAR (DIFF)" as before.
|
||
|
||
Read `autoplan-voices` and `design-outside-voices` for the coverage detail below the dashboard. Group by workflow run and phase, not merely skill. Show each phase’s recorded provider and outside_status; partial coverage must remain partial. These records do not change the engineering gate.
|
||
|
||
Display:
|
||
|
||
```
|
||
+====================================================================+
|
||
| REVIEW READINESS DASHBOARD |
|
||
+====================================================================+
|
||
| Review | Runs | Last Run | Status | Required |
|
||
|-----------------|------|---------------------|-----------|----------|
|
||
| Eng Review | 1 | 2026-03-16 15:00 | CLEAR | YES |
|
||
| CEO Review | 0 | — | — | no |
|
||
| Design Review | 0 | — | — | no |
|
||
| Adversarial | 0 | — | — | no |
|
||
| Outside Voice | 0 | — | — | no |
|
||
+--------------------------------------------------------------------+
|
||
| VERDICT: CLEARED — Eng Review passed |
|
||
+====================================================================+
|
||
```
|
||
|
||
**Review tiers:**
|
||
- **Eng Review (required by default):** The only review that gates shipping. Covers architecture, code quality, tests, performance. Can be disabled globally with \`gstack-config set skip_eng_review true\` (the "don't bother me" setting).
|
||
- **CEO Review (optional):** Use your judgment. Recommend it for big product/business changes, new user-facing features, or scope decisions. Skip for bug fixes, refactors, infra, and cleanup.
|
||
- **Design Review (optional):** Use your judgment. Recommend it for UI/UX changes. Skip for backend-only, infra, or prompt-only changes.
|
||
- **Adversarial Review (automatic):** Always-on for every review. Every diff gets a native adversarial pass and, when enabled and available, a host-selected outside challenge. Large diffs (200+ lines) additionally get a structured outside review with P1 gate.
|
||
- **Outside Voice (default-on):** Independent plan review through the host-selected provider after /plan-ceo-review and /plan-eng-review. The codex_reviews switch disables the entire extra step. Provider failure uses the existing native fallback and reports missing outside coverage. Never gates shipping.
|
||
|
||
**Verdict logic:**
|
||
- **CLEARED**: Eng Review has >= 1 entry within 7 days from either \`review\` or \`plan-eng-review\` with status "clean" (or \`skip_eng_review\` is \`true\`)
|
||
- **NOT CLEARED**: Eng Review missing, stale (>7 days), or has open issues
|
||
- CEO, Design, and outside reviews are shown for context but never block shipping
|
||
- If \`skip_eng_review\` config is \`true\`, Eng Review shows "SKIPPED (global)" and verdict is CLEARED
|
||
|
||
**Staleness detection:** After displaying the dashboard, check if any existing reviews may be stale:
|
||
- **Content-first rule (diff-scoped rows only: \`review\`, \`adversarial-review\`, \`codex-review\`, ship-stage entries).** Parse the \`---WTREE---\` and \`---DIRTY---\` sections from the bash output. If an entry has a \`wtree\` field AND it equals the current \`---WTREE---\` value, the review is CURRENT — identical content, regardless of commit count, rebase, amend, or whether it was committed yet (wtree equality alone proves identical content; that is the keystone property). Skip the commit-count heuristic for that entry and show no staleness note.
|
||
- Plan-tier rows (plan-ceo-review, plan-eng-review, plan-design-review) grade a plan file, not the repo tree — never apply the wtree rule to them; they keep the 7-day freshness logic. If such an entry carries a \`plan_sha256\` field, you MAY compare it against the current plan file's sha256 and note "plan changed since review" on mismatch.
|
||
- Fallback (no \`wtree\` on the entry, or wtree mismatch): parse the \`---HEAD---\` section to get the current HEAD commit hash. For each review entry that has a \`commit\` field: compare it against the current HEAD. If different, count elapsed commits: \`git rev-list --count STORED_COMMIT..HEAD\`. If that command FAILS (the stored commit was rebased away), grade UNKNOWN and treat as stale — do not error. Display: "Note: {skill} review from {date} may be stale — {N} commits since review"
|
||
- For entries without a \`commit\` field (legacy entries): display "Note: {skill} review from {date} has no commit tracking — consider re-running for accurate staleness detection"
|
||
- If all reviews grade CURRENT (wtree match or HEAD match), do not display any staleness notes
|
||
|
||
## Plan File Review Report
|
||
|
||
After displaying the Review Readiness Dashboard in conversation output, also update the
|
||
**plan file** itself so review status is visible to anyone reading the plan.
|
||
|
||
### Detect the plan file
|
||
|
||
1. Check if there is an active plan file in this conversation (the host provides plan file
|
||
paths in system messages — look for plan file references in the conversation context).
|
||
2. If not found, skip this section silently — not every review runs in plan mode.
|
||
|
||
### Generate the report
|
||
|
||
Read the review log output you already have from the Review Readiness Dashboard step above.
|
||
Parse each JSONL entry using recorded provenance. Historical source "claude" is a native Claude subagent; "claude-code" is the external CLI. Keep historical codex identifiers and never relabel old records from the current harness. Unknown model identity remains unknown. For new records, show host, outside_provider, outside_status, and phase. Only completed external records establish outside coverage; native fallbacks do not.
|
||
|
||
Each skill logs different fields:
|
||
|
||
- **plan-ceo-review**: \`status\`, \`unresolved\`, \`critical_gaps\`, \`mode\`, \`scope_proposed\`, \`scope_accepted\`, \`scope_deferred\`, \`commit\`
|
||
→ Findings: "{scope_proposed} proposals, {scope_accepted} accepted, {scope_deferred} deferred"
|
||
→ If scope fields are 0 or missing (HOLD/REDUCTION mode): "mode: {mode}, {critical_gaps} critical gaps"
|
||
- **plan-eng-review**: \`status\`, \`unresolved\`, \`critical_gaps\`, \`issues_found\`, \`mode\`, \`commit\`
|
||
→ Findings: "{issues_found} issues, {critical_gaps} critical gaps"
|
||
- **plan-design-review**: \`status\`, \`initial_score\`, \`overall_score\`, \`unresolved\`, \`decisions_made\`, \`commit\`
|
||
→ Findings: "score: {initial_score}/10 → {overall_score}/10, {decisions_made} decisions"
|
||
- **plan-devex-review**: \`status\`, \`initial_score\`, \`overall_score\`, \`product_type\`, \`tthw_current\`, \`tthw_target\`, \`mode\`, \`persona\`, \`competitive_tier\`, \`unresolved\`, \`commit\`
|
||
→ Findings: "score: {initial_score}/10 → {overall_score}/10, TTHW: {tthw_current} → {tthw_target}"
|
||
- **devex-review**: \`status\`, \`overall_score\`, \`product_type\`, \`tthw_measured\`, \`dimensions_tested\`, \`dimensions_inferred\`, \`boomerang\`, \`commit\`
|
||
→ Findings: "score: {overall_score}/10, TTHW: {tthw_measured}, {dimensions_tested} tested/{dimensions_inferred} inferred"
|
||
- **codex-review**: \`status\`, \`gate\`, \`findings\`, \`findings_fixed\`
|
||
→ Findings: "{findings} findings, {findings_fixed}/{findings} fixed"
|
||
|
||
All fields needed for the Findings column are now present in the JSONL entries.
|
||
For the review you just completed, you may use richer details from your own Completion
|
||
Summary. For prior reviews, use the JSONL fields directly — they contain all required data.
|
||
|
||
Produce this markdown table:
|
||
|
||
\`\`\`markdown
|
||
## GSTACK REVIEW REPORT
|
||
|
||
| Review | Trigger | Why | Runs | Status | Findings |
|
||
|--------|---------|-----|------|--------|----------|
|
||
| CEO Review | \`/plan-ceo-review\` | Scope & strategy | {runs} | {status} | {findings} |
|
||
| Outside Review | {recorded provider and trigger} | Independent 2nd opinion | {runs} | {outside_status} | {findings} |
|
||
| Eng Review | \`/plan-eng-review\` | Architecture & tests (required) | {runs} | {status} | {findings} |
|
||
| Design Review | \`/plan-design-review\` | UI/UX gaps | {runs} | {status} | {findings} |
|
||
| DX Review | \`/plan-devex-review\` | Developer experience gaps | {runs} | {status} | {findings} |
|
||
\`\`\`
|
||
|
||
Below the table, add these lines. **OUTSIDE COVERAGE** and **CROSS-MODEL** are optional (omit when
|
||
empty); **VERDICT** is always present:
|
||
|
||
- **OUTSIDE COVERAGE:** provider, phase, completion state, and findings. Include unavailable, disabled, and skipped phases; never infer completion from another phase.
|
||
- **CROSS-MODEL:** only when native and completed external reviews exist — overlap analysis with recorded providers and known model identity. Do not infer distinct model families from harness names.
|
||
- **VERDICT:** list reviews that are CLEAR (e.g., "CEO + ENG CLEARED — ready to implement").
|
||
If Eng Review is not CLEAR and not skipped globally, append "eng review required".
|
||
|
||
**Unresolved-decisions status (MANDATORY — never omitted; the report's final non-whitespace
|
||
line).** After VERDICT, end the report (content under the \`## GSTACK REVIEW REPORT\`
|
||
heading — a bold label, never a new \`## \` heading; exempt from the "omit when empty"
|
||
rule) with exactly one: the exact unbolded line \`NO UNRESOLVED DECISIONS\` (a bolded one
|
||
does NOT count), OR a \`**UNRESOLVED DECISIONS:**\` header + one bullet per open item
|
||
(last bullet = final line; add \`+ N unresolved from prior reviews\` only when N > 0).
|
||
This avoids double-counting: list THIS review's open items from context; for prior reviews
|
||
sum \`unresolved\` over the latest fresh row per skill (dashboard 7-day window) after you
|
||
DROP the current skill's row; emit the sentinel only when both are zero.
|
||
|
||
### Write to the plan file
|
||
|
||
**PLAN MODE EXCEPTION — ALWAYS RUN:** This writes to the plan file, which is the one
|
||
file you are allowed to edit in plan mode. The plan file review report is part of the
|
||
plan's living status.
|
||
|
||
The report must always be the LAST section of the plan file — never mid-file.
|
||
Use a single delete-then-append flow:
|
||
|
||
1. Read the plan file (Read tool) to see its full current content. Search the read
|
||
output for a \`## GSTACK REVIEW REPORT\` heading anywhere in the file.
|
||
2. If found, use the Edit tool to DELETE the entire existing section. Match from
|
||
\`## GSTACK REVIEW REPORT\` through either the next \`## \` heading or end of
|
||
file, whichever comes first. Replace with the empty string. This applies
|
||
regardless of where the section currently lives — mid-file deletion is
|
||
intentional, not a special case. If the Edit fails (e.g., concurrent edit
|
||
changed the content), re-read the plan file and retry once.
|
||
3. After the delete (or skipped, if no section existed), append the new
|
||
\`## GSTACK REVIEW REPORT\` section at the END of the file. Use the Edit
|
||
tool to match the file's current last paragraph and add the section after it,
|
||
or use Write to re-emit the whole file with the section at the end.
|
||
4. Verify with the Read tool that \`## GSTACK REVIEW REPORT\` is the last
|
||
\`## \` heading in the file before continuing. If it isn't, repeat steps
|
||
2-3 once.
|
||
|
||
Do NOT replace the section in place. The "replace mid-file" path is what allowed
|
||
prior versions to leave the report mid-file when an older report already lived
|
||
there — the user then sees a plan whose review report is not at the bottom and
|
||
(correctly) rejects it.
|
||
|
||
## Capture Learnings
|
||
|
||
If you discovered a non-obvious pattern, pitfall, or architectural insight during
|
||
this session, log it for future sessions:
|
||
|
||
```bash
|
||
~/.claude/skills/gstack/bin/gstack-learnings-log '{"skill":"plan-eng-review","type":"TYPE","key":"SHORT_KEY","insight":"DESCRIPTION","confidence":N,"source":"SOURCE","files":["path/to/relevant/file"]}'
|
||
```
|
||
|
||
**Types:** `pattern` (reusable approach), `pitfall` (what NOT to do), `preference`
|
||
(user stated), `architecture` (structural decision), `tool` (library/framework insight),
|
||
`operational` (project environment/CLI/workflow knowledge).
|
||
|
||
**Sources:** `observed` (you found this in the code), `user-stated` (user told you),
|
||
`inferred` (AI deduction), `cross-model` (both Claude and Codex agree).
|
||
|
||
**Confidence:** 1-10. Be honest. An observed pattern you verified in the code is 8-9.
|
||
An inference you're not sure about is 4-5. A user preference they explicitly stated is 10.
|
||
|
||
**files:** Include the specific file paths this learning references. This enables
|
||
staleness detection: if those files are later deleted, the learning can be flagged.
|
||
|
||
**Only log genuine discoveries.** Don't log obvious things. Don't log things the user
|
||
already knows. A good test: would this insight save time in a future session? If yes, log it.
|
||
|
||
|
||
|
||
## Brain Calibration Write-Back (Phase 2 / gated)
|
||
|
||
When the skill makes a typed prediction worth tracking (scope decision,
|
||
TTHW target, architectural bet, wedge commitment), it MAY write a
|
||
`kind=bet` take to the brain so a calibration profile builds over time.
|
||
|
||
**Gated on two things:**
|
||
1. Brain trust policy for the active endpoint is `personal` (check via
|
||
`~/.claude/skills/gstack/bin/gstack-config get brain_trust_policy@<endpoint-hash>`).
|
||
Shared brains skip write-back to avoid polluting team calibration.
|
||
2. Feature flag `BRAIN_CALIBRATION_WRITEBACK` is set (today: false; flips
|
||
to true when upstream gbrain v0.42+ ships `takes_add` MCP op).
|
||
|
||
When both gates pass, the write-back path uses `mcp__gbrain__takes_add`
|
||
to record a take with weight 0.7 (per SKILL_CALIBRATION_WEIGHTS).
|
||
If the MCP op is unavailable, fall back to `mcp__gbrain__put_page` with
|
||
a gstack:takes fence block (documented but uglier path).
|
||
|
||
Mandatory take frontmatter shape:
|
||
```yaml
|
||
kind: bet
|
||
holder: <user identity from whoami>
|
||
claim: <one-line prediction the skill is making>
|
||
weight: 0.7
|
||
since_date: <today's date>
|
||
expected_resolution: <date in 1-3 months depending on skill>
|
||
source_skill: plan-eng-review
|
||
```
|
||
|
||
After write, invalidate the affected digests so the next preflight reflects
|
||
the new state:
|
||
|
||
```bash
|
||
eval "$(~/.claude/skills/gstack/bin/gstack-slug 2>/dev/null)" 2>/dev/null || true
|
||
# (no per-skill invalidation targets configured)
|
||
```
|
||
|
||
|
||
## Brain Cache Background Refresh
|
||
|
||
After the skill's work completes (and telemetry has logged), kick a
|
||
background refresh of any cache digest that's getting close to its TTL.
|
||
This is non-blocking — the user doesn't wait. Next invocation benefits
|
||
from the warm cache.
|
||
|
||
```bash
|
||
eval "$(~/.claude/skills/gstack/bin/gstack-slug 2>/dev/null)" 2>/dev/null || true
|
||
(~/.claude/skills/gstack/bin/gstack-brain-cache refresh --project "$SLUG" 2>/dev/null &) || true
|
||
```
|
||
|
||
|
||
## Next Steps — Review Chaining
|
||
|
||
After displaying the Review Readiness Dashboard, check if additional reviews would be valuable. Read the dashboard output to see which reviews have already been run and whether they are stale.
|
||
|
||
**Suggest /plan-design-review if UI changes exist and no design review has been run** — detect from the test diagram, architecture review, or any section that touched frontend components, CSS, views, or user-facing interaction flows. If an existing design review's commit hash shows it predates significant changes found in this eng review, note that it may be stale.
|
||
|
||
**Mention /plan-ceo-review if this is a significant product change and no CEO review exists** — this is a soft suggestion, not a push. CEO review is optional. Only mention it if the plan introduces new user-facing features, changes product direction, or expands scope substantially.
|
||
|
||
**Note staleness** of existing CEO or design reviews if this eng review found assumptions that contradict them, or if the commit hash shows significant drift.
|
||
|
||
**If no additional reviews are needed** (or `skip_eng_review` is `true` in the dashboard config, meaning this eng review was optional): state "All relevant reviews complete. Run /ship when ready."
|
||
|
||
**Navigation only.** Match task prerequisites, dependencies and execution order to the written plan; do not add or strengthen them in this question or its option descriptions. A test required before editing one function does not make every independent lane wait for it.
|
||
|
||
If a substantive late change is needed, return to the individual issue-approval loop. After the answer, update the plan's tasks and dependency/parallelization sections, refresh the review report and log, then Read the updated plan and rerun the exit gate before ExitPlanMode. A next-step answer alone approves no implementation change.
|
||
|
||
Use AskUserQuestion with only the applicable options:
|
||
- **A)** Run /plan-design-review (only if UI scope detected and no design review exists)
|
||
- **B)** Run /plan-ceo-review (only if significant product change and no CEO review exists)
|
||
- **C)** Ready to implement — run /ship when done
|