Two fixes to get the E2E actually running end-to-end (first attempt
failed at the SDK auth step, second at the assertion step):
1. Don't pass an explicit `env:` object to runAgentSdkTest. The SDK's
auth pipeline misses ANTHROPIC_API_KEY when env is supplied as an
object (verified against the plan-mode-no-op test, which passes no
env and auths cleanly). Mutate process.env before the call instead,
and restore the originals in finally so other tests don't inherit
the ambient mutation.
2. The "Run /learn with no arguments" user prompt was too narrow — the
model reduced it to a direct action and skipped the preamble
privacy-gate directives entirely, so zero AskUserQuestions fired.
Mirror the plan-mode-no-op pattern: point the model at the skill
file on disk and ask it to follow every preamble directive. Bumped
maxTurns from 6 to 10 to give the preamble room to execute.
Verified both tests pass under `EVALS=1 EVALS_TIER=periodic bun test
test/skill-e2e-brain-privacy-gate.test.ts` against a real ANTHROPIC_API_KEY.
Cost per run: ~$0.30-$0.50 per test.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Garry Tan
371a7e684a