skill-e2e-auq-format-compliance.test.ts (~$0.50/run, 90-130s):
- Asserts /plan-ceo-review's first AUQ contains all 7 mandated format
elements (ELI10, Recommendation, Pros/Cons with ✅/❌, Net,
(recommended) label). Catches drift in the shared preamble resolver
that previously took weeks to notice.
- Auto-grants permission dialogs that fire during preamble side-effects
(touch on .feature-prompted markers in fresh user environments).
- Verified PASS in 126s.
skill-e2e-plan-design-with-ui.test.ts (~$0.80/run, 50-90s):
- Counterpart to the existing no-UI early-exit test. When the input plan
DOES describe UI changes, /plan-design-review must NOT early-exit and
must reach a real skill AUQ.
- Sends the slash command without args, then a follow-up message with
the UI-heavy plan description (Claude Code rejects unknown trailing
args). Asserts evidence does NOT contain "no UI scope".
- Verified PASS in 54s.
skill-budget-regression.test.ts (free, gate):
- Library-only assertion. Reads the most recent eval file, finds the
prior same-branch run via findPreviousRun, computes ComparisonResult,
asserts no test exceeded 2× tools or turns.
- Branch-scoped: skips with reason if the latest eval was produced on
a different branch (cross-branch comparison would be noise).
- First-run grace (vacuous pass) when no prior data exists.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Garry Tan