From 730a88d490a7701eb505576b2623429c4e4cdc22 Mon Sep 17 00:00:00 2001 From: garrytan Date: Mon, 2 Nov 2026 02:13:25 +0000 Subject: [PATCH] docs(skills): /eval-plan entry names the R54 frontier check Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com> --- docs/skills.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/skills.md b/docs/skills.md index 5ce9fe9dd..5d6325357 100644 --- a/docs/skills.md +++ b/docs/skills.md @@ -961,7 +961,10 @@ arms, decoys, stop rules, cap) and `--check` refuses to continue while a field i blank (`PREREG_INCOMPLETE`). `arms` resolves the `eval-arms` model role against `lib/pricing.ts` and stops on an unpriced model (`EVAL_PRICE_MISSING`); `dry-run` runs every row through the stub model for $0 and flags malformed rows -(`EVAL_DRY_RUN_FAILED`); `pilot start|settle|release|report` runs three priced +(`EVAL_DRY_RUN_FAILED`), and refuses a plan whose every arm is Haiku or Sonnet +unless `--tier-question` names what it asks about that tier, re-costing it on +frontier models ([frontier models under test](TESTING_INTERNALS.md#frontier-models-under-test)); +`pilot start|settle|release|report` runs three priced items, records actual spend, extrapolates each priced arm to the full set against the cap (`EVAL_BUDGET_EXHAUSTED`) and prints the spend table the approval question shows. An arm on a subscription with no extra charge is declared with