From 4cf49c74d4e64ae1f77ce6ab539341d29c7c29e9 Mon Sep 17 00:00:00 2001 From: garrytan Date: Thu, 1 Oct 2026 00:38:34 +0000 Subject: [PATCH] test(plan-ceo floor): the request answers only the questions it names PR lane 36794871032 (head 20d6e98f): the CEO floor ran 608 s without a question. Its Step 0 recorded the premise gap and approach choice as unresolved ledger rows, then said "this session supplies all answers up front, so no decision brief was dispatched" and wrote Sections 1-11. 2734e203 stopped scope preservation from approving the premise; this time the actor block (declined setup, recall, outside voices, HOLD SCOPE) and the fixture's "complete user request is available from the start" were read as pre-answering every review question. The CEO actor now states that the request answers only the routing, recall, outside-reviewer and review-mode questions it names. --- test/helpers/claude-pty-runner.ts | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/test/helpers/claude-pty-runner.ts b/test/helpers/claude-pty-runner.ts index eee07e9a9..896fda8f4 100644 --- a/test/helpers/claude-pty-runner.ts +++ b/test/helpers/claude-pty-runner.ts @@ -4721,8 +4721,9 @@ export async function runPlanSkillFloorCheck(opts: { 'This actor has already declined routing setup, cross-project recall and outside reviewers.', 'Preserve the supplied product scope. For review-mode questions choose HOLD SCOPE (CEO), DX POLISH (DX), or the full BIG CHANGE review (Eng). Design: review all seven dimensions.', // Runs 36626737820 and 36776104571: CEO read scope preservation as approving - // approach A, so the seeded premise gap never reached a question. - ...(opts.skillName === 'plan-ceo-review' ? ['Preserving scope does not approve the plan\'s premise, approach or any remedy.'] : []), + // approach A, so the seeded premise gap never reached a question. Run 36794871032: + // CEO read this request as supplying every answer up front and asked nothing. + ...(opts.skillName === 'plan-ceo-review' ? ['Preserving scope does not approve the plan\'s premise, approach or any remedy. This request answers only the routing, recall, outside-reviewer and review-mode questions named above.'] : []), ...(opts.productType === 'sdk-documentation' ? [ 'Product type is confirmed: SDK quickstart documentation, with the complete journey to the first SDK call as context. If asked to classify, choose SDK + Docs when offered, otherwise Documentation. This confirms the review lens; it does not expand the plan.', 'Target persona is confirmed: a hands-on developer integrating this SDK for the first time, trying to make one successful call. Product type and persona setup are already answered; proceed to reviewing the supplied plan.',