Commit Graph

2 Commits

Author SHA1 Message Date
Garry Tan 4e0516031b test(security): 4 new ensemble tests — 3-way agreement rule
Covers the new combineVerdict behavior when DeBERTa is in the pool:
  * testsavant + deberta at WARN → BLOCK (cross-family agreement)
  * deberta alone high → WARN (no cross-confirm)
  * all three ML layers at WARN → BLOCK, confidence = MIN (conservative)
  * deberta disabled (confidence 0, meta.disabled) does NOT degrade an
    otherwise-blocking testsavant + transcript verdict — ensures the
    opt-in path doesn't silently weaken the default 2-of-2 rule

security.test.ts: 29 tests / 71 expectations.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-20 04:55:23 +08:00
Garry Tan 1a1a182251 test(security): add security.ts unit tests (25 tests, 62 assertions)
Covers the pure-string operations that must behave deterministically in both
compiled and source-mode bun contexts:

  * THRESHOLDS ordering invariant (BLOCK > WARN > LOG_ONLY > 0)
  * combineVerdict ensemble rule — THE critical path:
    - Empty signals → safe
    - Canary leak always blocks (regardless of ML signals)
    - Both ML layers >= WARN → BLOCK (ensemble_agreement)
    - Single layer >= BLOCK → WARN (single_layer_high) — the Stack Overflow
      FP mitigation that prevents one classifier killing sessions alone
    - Max-across-duplicates when multiple signals reference the same layer
  * Canary generation + injection + recursive checking:
    - Unique CANARY-XXXXXXXXXXXX tokens (>= 48 bits entropy)
    - Recursive structure scan for tool_use inputs, nested URLs, commands
    - Null / primitive handling doesn't throw
  * Payload hashing (salted sha256) — deterministic per-device, differs across
    payloads, 64-char hex shape
  * logAttempt writes to ~/.gstack/security/attempts.jsonl
  * writeSessionState + readSessionState round-trip (cross-process)
  * getStatus returns valid SecurityStatus shape
  * extractDomain returns hostname only, empty string on bad input

All 25 tests pass in 18ms — no ML, no network, no subprocess spawning.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-19 19:06:52 +08:00