garrytan
a5b66d5cb4
test(llm-judge): run the ship workflow judge at medium effort so its panel fits JUDGE_MS
...
claude-fable-5-1 accepts only adaptive thinking (thinking.type.enabled with
budget_tokens returns 400), so effort is the available thinking control.
Measured on the exact ship judge request (105,301 input tokens):
- default effort, 18 samples: thinking 5,086-10,881 tokens, 75.9-144.7 s;
3 of 18 passed the 120 s deadline (about 42% of 3-sample panels).
- medium effort, 18 samples: thinking 2,749-5,762, output at most 6,144
tokens, 43.1-77.9 s; scores 4/4/4 in 16 of 18 (clarity 3 in two), versus
14 of 18 at default.
callJudge gains an effort option sent as output_config.effort; only the ship
judge sets it. Rubric, floors, panel size, deadline, model and max_tokens are
unchanged. The cache identity records effort.
2026-10-01 00:37:03 +00:00
..
2026-09-30 22:07:25 +00:00
2026-10-01 00:37:03 +00:00
2026-09-29 19:51:35 +00:00
2026-09-30 22:02:15 +00:00
2026-09-30 22:02:15 +00:00
2026-09-30 22:02:15 +00:00
2026-09-30 12:58:14 +00:00
2026-09-29 14:35:00 -07:00
2026-09-30 12:52:56 +00:00
2026-09-30 12:52:56 +00:00
2026-09-30 12:52:56 +00:00
2026-09-29 17:05:15 +00:00
2026-09-29 21:33:13 +00:00
2026-09-29 21:33:13 +00:00
2026-09-29 19:41:39 +00:00
2026-09-29 16:19:52 +00:00
2026-09-29 19:34:33 +00:00
2026-09-30 17:59:23 +00:00
2026-09-29 22:00:14 +00:00
2026-09-29 19:11:04 +00:00
2026-09-30 22:07:25 +00:00
2026-09-29 22:36:28 +00:00
2026-09-29 17:02:31 +00:00
2026-09-30 16:30:43 +00:00
2026-09-29 16:47:24 +00:00
2026-09-29 19:41:39 +00:00
2026-09-29 16:19:52 +00:00
2026-09-29 22:00:14 +00:00
2026-09-29 20:12:02 +00:00
2026-09-29 16:19:52 +00:00
2026-09-29 19:13:54 +00:00
2026-09-29 19:11:04 +00:00
2026-09-29 19:34:33 +00:00
2026-09-29 14:35:00 -07:00
2026-09-30 17:59:23 +00:00
2026-09-30 17:59:23 +00:00
2026-09-30 12:52:56 +00:00
2026-09-29 19:51:35 +00:00
2026-10-01 00:37:03 +00:00
2026-09-29 22:46:30 +00:00
2026-09-30 13:04:59 +00:00
2026-09-30 22:07:25 +00:00
2026-09-29 19:30:43 +00:00
2026-09-29 19:09:51 +00:00
2026-09-29 19:23:55 +00:00
2026-09-29 19:41:39 +00:00
2026-09-29 22:00:14 +00:00
2026-09-29 22:00:14 +00:00
2026-09-30 12:24:05 +00:00
2026-09-29 19:11:27 +00:00
2026-09-29 19:47:15 +00:00
2026-09-30 23:23:18 +00:00
2026-09-29 22:36:28 +00:00
2026-09-30 12:24:05 +00:00
2026-09-29 19:51:35 +00:00
2026-09-29 20:43:00 +00:00
2026-09-29 14:35:00 -07:00
2026-09-29 14:35:00 -07:00
2026-09-30 19:49:54 +00:00
2026-09-30 18:57:26 +00:00
2026-09-30 23:57:09 +00:00
2026-09-30 16:19:39 +00:00
2026-09-30 18:34:36 +00:00
2026-09-30 12:11:34 +00:00
2026-09-30 18:34:36 +00:00
2026-09-30 12:11:34 +00:00
2026-09-30 12:24:05 +00:00
2026-09-30 20:54:35 +00:00
2026-09-30 20:54:35 +00:00
2026-09-29 22:49:12 +00:00
2026-09-30 20:54:35 +00:00
2026-09-30 22:02:15 +00:00
2026-09-29 18:56:27 +00:00
2026-09-30 12:24:05 +00:00
2026-09-30 19:36:02 +00:00
2026-09-30 22:07:25 +00:00
2026-09-30 18:52:14 +00:00
2026-09-30 19:36:02 +00:00
2026-09-30 19:36:02 +00:00
2026-09-30 12:11:34 +00:00
2026-09-29 19:09:51 +00:00
2026-09-29 19:09:51 +00:00
2026-09-29 22:00:14 +00:00
2026-09-29 20:28:31 +00:00
2026-09-30 22:02:15 +00:00
2026-09-30 22:02:15 +00:00
2026-09-30 23:23:18 +00:00
2026-09-30 22:07:25 +00:00
2026-09-30 12:52:56 +00:00
2026-09-30 23:23:18 +00:00
2026-09-29 21:26:37 +00:00
2026-09-29 22:36:28 +00:00
2026-09-29 19:15:06 +00:00
2026-09-30 23:49:53 +00:00
2026-09-29 17:28:32 +00:00
2026-09-29 20:28:31 +00:00
2026-09-30 20:54:35 +00:00
2026-09-30 22:07:25 +00:00
2026-09-30 12:24:05 +00:00
2026-09-30 11:35:24 +00:00
2026-09-30 19:36:02 +00:00
2026-09-29 16:47:24 +00:00
2026-09-29 14:35:00 -07:00
2026-09-30 19:48:40 +00:00
2026-10-01 00:37:03 +00:00
2026-09-29 14:35:00 -07:00
2026-09-29 14:35:00 -07:00
2026-09-30 21:07:08 +00:00
2026-09-30 23:23:18 +00:00
2026-09-29 14:35:00 -07:00
2026-09-29 20:43:00 +00:00
2026-09-29 19:09:51 +00:00
2026-10-01 00:37:03 +00:00