Files
gstack/test
garrytan 7b64db8351 test: default-config workflow judges send their schema after calibration (W2 T8)
Comparison (1) on the 24-item workflow-default corpus (14 eval cases):
old-vs-old 2/23 flips, new-vs-old 3/23 (within old + 1), agreement 21/24
for old and new, zero false passes under the new prompt (old-a had a06),
p95 25.8 s new vs 29.5 s old; held-out 0/8 flips, 8/8 agreement. Item f03
(stubbed cookie-import workflow) drew one provider refusal under each
prompt, so its panels are incomplete and excluded from flips; that errored
new sample triggers the UC3 prose step, deferred to TODOS. The 14 cases
get schemaTransport without the compact-reasoning validator; review and
setup-browser-cookies stay on today's request. Funded by a $25 extension
of the W2 reservation. 216 calls, $19.66.
2026-10-03 21:46:15 +00:00
..