fix(evals): AUQ A/B vendored pre-cut arm + judge-error inconclusive taxonomy

Browse Source

- The PRE arm read a branch-local SHA (3263fffe) that becomes unreachable on
  fresh clones after the squash-merge; the pre-cut render is now a vendored
  fixture.
- A judge failure on one side no longer coerces substance to 0 (which
  fabricated DEGRADATION on POST-side failures and masked regressions on
  PRE-side failures): null substance = inconclusive, format still gates.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

...

This commit is contained in:

Garry Tan

2026-08-29 05:18:52 +00:00

co-authored by Claude Fable 5

parent 83de97e152

commit 4d5af0efe4

2 changed files with 1153 additions and 12 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

test/fixtures/auq-pre-cut-plan-ceo-review-SKILL.md

Vendored

+1127

File diff suppressed because it is too large Load Diff