garrytan
e36c82374e
test(evals): bound the review judge's thinking; guarded browser cleanup is not a probe
...
review/SKILL.md workflow: the ~64k-token bundle let default-effort thinking
spend all 8192 output tokens without an answer in CI. Medium effort with a
64k streaming cap kept 24/24 measured samples under 5k tokens and 63 s with
the same gating scores (as ship already does).
qa-only-no-fix: the fixture prompt routes browser cleanup through the deadline
guard, but the checkpoint detector treated every guarded run as a probe that
needs a checkpoint. A child that only closes the tab with the supplied browse
binary, after the last probe, is cleanup; anything else stays a probe. The
captured CI transcript (run 37252022510) now passes and new scenarios pin
the negative controls.
2026-10-05 02:19:50 +00:00
..
2026-09-29 08:58:49 -07:00
2026-10-04 07:58:41 -07:00
2026-09-25 13:27:07 -04:00
2026-08-15 22:20:30 -07:00
2026-08-29 10:10:35 -07:00
2026-09-06 08:54:25 -07:00
2026-10-03 07:54:09 -07:00
2026-09-25 13:27:07 -04:00
2026-10-04 07:58:41 -07:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-09-22 14:57:52 -04:00
2026-10-04 07:58:41 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-14 14:32:45 -07:00
2026-09-05 14:45:28 -07:00
2026-09-09 08:57:21 -07:00
2026-04-19 17:50:31 +08:00
2026-09-29 06:07:35 -07:00
2026-10-03 18:49:34 -07:00
2026-10-05 01:29:54 +00:00
2026-05-26 16:50:03 -07:00
2026-08-27 09:50:31 -07:00
2026-05-26 16:50:03 -07:00
2026-08-31 08:55:30 -07:00
2026-06-07 19:13:24 -07:00
2026-10-05 01:29:54 +00:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-10-04 07:58:41 -07:00
2026-10-01 13:55:16 -07:00
2026-10-04 07:58:41 -07:00
2026-10-01 13:55:16 -07:00
2026-10-03 01:19:03 -07:00
2026-10-04 07:58:41 -07:00
2026-10-05 01:29:54 +00:00
2026-10-01 11:57:48 -07:00
2026-10-01 13:55:16 -07:00
2026-10-01 11:57:48 -07:00
2026-10-01 11:57:48 -07:00
2026-10-01 11:57:48 -07:00
2026-10-04 07:58:41 -07:00
2026-09-22 14:57:52 -04:00
2026-10-03 07:54:09 -07:00
2026-10-04 07:58:41 -07:00
2026-10-03 18:49:34 -07:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-09-26 18:57:53 -04:00
2026-09-25 12:06:45 -04:00
2026-10-03 07:54:09 -07:00
2026-10-03 07:54:09 -07:00
2026-09-29 08:58:49 -07:00
2026-09-25 12:06:45 -04:00
2026-09-14 15:14:58 -07:00
2026-10-05 01:07:53 +00:00
2026-10-03 01:19:03 -07:00
2026-09-29 06:07:35 -07:00
2026-10-01 11:57:48 -07:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-09-14 14:32:45 -07:00
2026-10-05 01:29:54 +00:00
2026-10-05 01:29:54 +00:00
2026-10-03 07:54:09 -07:00
2026-08-24 08:55:58 -07:00
2026-09-14 14:32:45 -07:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-10-01 13:55:16 -07:00
2026-10-01 13:55:16 -07:00
2026-09-14 14:32:45 -07:00
2026-10-04 07:58:41 -07:00
2026-10-01 13:55:16 -07:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-10-05 01:29:54 +00:00
2026-08-28 11:43:13 -07:00
2026-10-04 07:58:41 -07:00
2026-10-02 11:11:00 -07:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-10-03 18:49:34 -07:00
2026-10-03 18:49:34 -07:00
2026-10-04 07:58:41 -07:00
2026-10-01 11:57:48 -07:00
2026-10-04 07:58:41 -07:00
2026-10-05 01:29:54 +00:00
2026-10-05 01:29:54 +00:00
2026-10-03 01:19:03 -07:00
2026-10-04 07:58:41 -07:00
2026-09-29 06:07:35 -07:00
2026-09-14 14:32:45 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 18:49:34 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-09-14 15:14:58 -07:00
2026-10-05 01:29:54 +00:00
2026-09-24 01:53:58 -04:00
2026-10-03 07:54:09 -07:00
2026-10-03 07:54:09 -07:00
2026-09-14 14:32:45 -07:00
2026-09-24 01:53:58 -04:00
2026-09-22 14:57:52 -04:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-10-03 18:49:34 -07:00
2026-09-14 14:32:45 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 01:19:03 -07:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-10-01 13:55:16 -07:00
2026-09-14 14:32:45 -07:00
2026-10-01 13:55:16 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-03 07:54:09 -07:00
2026-10-05 01:29:54 +00:00
2026-10-01 11:57:48 -07:00
2026-09-14 14:32:45 -07:00
2026-10-05 02:19:50 +00:00
2026-10-04 07:58:41 -07:00
2026-10-03 18:49:34 -07:00
2026-10-01 13:55:16 -07:00
2026-10-05 01:29:54 +00:00
2026-10-04 07:58:41 -07:00
2026-09-29 06:07:35 -07:00
2026-10-03 01:19:03 -07:00
2026-10-01 13:55:16 -07:00
2026-10-03 18:49:34 -07:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-08-29 09:06:54 -07:00
2026-08-29 09:06:54 -07:00
2026-10-03 18:49:34 -07:00
2026-09-29 08:58:49 -07:00
2026-04-24 01:38:21 -07:00
2026-09-29 06:07:35 -07:00
2026-09-23 08:54:53 -04:00
2026-10-03 07:54:09 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-01 13:55:16 -07:00
2026-10-04 07:58:41 -07:00
2026-09-29 06:07:35 -07:00
2026-10-04 07:58:41 -07:00
2026-09-24 01:53:58 -04:00
2026-09-29 06:07:35 -07:00
2026-10-03 07:54:09 -07:00
2026-09-29 06:07:35 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 01:19:03 -07:00
2026-08-14 09:28:56 -07:00
2026-09-29 06:07:35 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-01 13:55:16 -07:00
2026-10-01 13:55:16 -07:00
2026-10-01 13:55:16 -07:00
2026-10-03 01:19:03 -07:00
2026-09-25 13:27:07 -04:00
2026-09-06 08:54:25 -07:00
2026-09-29 08:58:49 -07:00
2026-10-05 01:29:54 +00:00
2026-08-15 22:20:30 -07:00
2026-10-03 07:54:09 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 18:49:34 -07:00
2026-10-03 01:19:03 -07:00