garrytan
a5b66d5cb4
test(llm-judge): run the ship workflow judge at medium effort so its panel fits JUDGE_MS
...
claude-fable-5-1 accepts only adaptive thinking (thinking.type.enabled with
budget_tokens returns 400), so effort is the available thinking control.
Measured on the exact ship judge request (105,301 input tokens):
- default effort, 18 samples: thinking 5,086-10,881 tokens, 75.9-144.7 s;
3 of 18 passed the 120 s deadline (about 42% of 3-sample panels).
- medium effort, 18 samples: thinking 2,749-5,762, output at most 6,144
tokens, 43.1-77.9 s; scores 4/4/4 in 16 of 18 (clarity 3 in two), versus
14 of 18 at default.
callJudge gains an effort option sent as output_config.effort; only the ship
judge sets it. Rubric, floors, panel size, deadline, model and max_tokens are
unchanged. The cache identity records effort.
2026-10-01 00:37:03 +00:00
..
2026-09-29 08:58:49 -07:00
2026-09-25 13:27:07 -04:00
2026-08-15 22:20:30 -07:00
2026-08-29 10:10:35 -07:00
2026-09-06 08:54:25 -07:00
2026-09-24 01:53:58 -04:00
2026-09-25 13:27:07 -04:00
2026-09-30 23:23:18 +00:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-09-22 14:57:52 -04:00
2026-09-30 22:02:15 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-14 14:32:45 -07:00
2026-09-05 14:45:28 -07:00
2026-09-09 08:57:21 -07:00
2026-04-19 17:50:31 +08:00
2026-09-29 06:07:35 -07:00
2026-08-29 09:06:54 -07:00
2026-05-26 16:50:03 -07:00
2026-08-27 09:50:31 -07:00
2026-05-26 16:50:03 -07:00
2026-08-31 08:55:30 -07:00
2026-06-07 19:13:24 -07:00
2026-09-30 12:52:56 +00:00
2026-09-22 14:57:52 -04:00
2026-09-30 12:52:56 +00:00
2026-09-29 08:58:49 -07:00
2026-09-29 16:57:54 +00:00
2026-09-30 12:52:56 +00:00
2026-09-29 17:05:15 +00:00
2026-09-29 15:18:46 +00:00
2026-09-22 14:57:52 -04:00
2026-09-30 22:02:15 +00:00
2026-09-29 17:07:38 +00:00
2026-09-26 18:57:53 -04:00
2026-09-22 14:57:52 -04:00
2026-09-30 17:59:23 +00:00
2026-09-26 18:57:53 -04:00
2026-09-25 12:06:45 -04:00
2026-09-30 22:07:25 +00:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-25 12:06:45 -04:00
2026-09-14 15:14:58 -07:00
2026-09-14 15:14:58 -07:00
2026-09-29 22:36:28 +00:00
2026-09-29 06:07:35 -07:00
2026-09-30 16:30:43 +00:00
2026-09-30 22:37:12 +00:00
2026-09-29 06:07:35 -07:00
2026-09-30 18:24:46 +00:00
2026-09-14 14:32:45 -07:00
2026-09-29 15:21:17 +00:00
2026-09-29 15:21:17 +00:00
2026-09-29 19:51:35 +00:00
2026-08-24 08:55:58 -07:00
2026-09-14 14:32:45 -07:00
2026-09-29 20:12:02 +00:00
2026-09-29 19:09:51 +00:00
2026-09-29 18:56:27 +00:00
2026-09-29 19:30:43 +00:00
2026-09-14 14:32:45 -07:00
2026-09-29 22:49:12 +00:00
2026-09-22 14:57:52 -04:00
2026-08-28 11:43:13 -07:00
2026-09-15 21:35:11 -07:00
2026-09-29 14:22:05 +00:00
2026-09-29 14:22:05 +00:00
2026-09-22 14:57:52 -04:00
2026-10-01 00:37:03 +00:00
2026-09-28 13:09:52 -07:00
2026-09-29 22:46:30 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-29 15:29:46 +00:00
2026-09-14 14:32:45 -07:00
2026-09-29 06:07:35 -07:00
2026-09-14 14:32:45 -07:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-14 15:14:58 -07:00
2026-09-29 19:11:27 +00:00
2026-09-29 15:04:28 +00:00
2026-09-29 19:47:15 +00:00
2026-09-22 14:57:52 -04:00
2026-09-14 14:32:45 -07:00
2026-09-24 01:53:58 -04:00
2026-09-22 14:57:52 -04:00
2026-09-30 12:24:05 +00:00
2026-09-14 14:32:45 -07:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-09-29 21:26:37 +00:00
2026-09-14 14:32:45 -07:00
2026-09-29 20:43:00 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-29 06:07:35 -07:00
2026-09-14 14:32:45 -07:00
2026-09-29 06:07:35 -07:00
2026-10-01 00:10:55 +00:00
2026-09-29 06:07:35 -07:00
2026-09-29 06:07:35 -07:00
2026-09-30 20:42:29 +00:00
2026-09-30 20:42:29 +00:00
2026-09-29 06:07:35 -07:00
2026-09-30 19:49:54 +00:00
2026-09-29 06:07:35 -07:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-08-29 09:06:54 -07:00
2026-08-29 09:06:54 -07:00
2026-09-29 08:58:49 -07:00
2026-04-24 01:38:21 -07:00
2026-09-29 06:07:35 -07:00
2026-09-23 08:54:53 -04:00
2026-09-30 16:04:19 +00:00
2026-09-28 16:00:12 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-30 12:24:05 +00:00
2026-09-30 19:36:02 +00:00
2026-09-29 06:07:35 -07:00
2026-09-30 22:07:25 +00:00
2026-09-24 01:53:58 -04:00
2026-09-29 06:07:35 -07:00
2026-09-26 18:57:53 -04:00
2026-09-29 06:07:35 -07:00
2026-08-14 09:28:56 -07:00
2026-09-29 06:07:35 -07:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-29 16:19:39 +00:00
2026-09-30 23:23:18 +00:00
2026-09-29 19:11:04 +00:00
2026-09-29 14:35:00 -07:00
2026-09-25 13:27:07 -04:00
2026-09-06 08:54:25 -07:00
2026-09-29 08:58:49 -07:00
2026-09-30 20:54:35 +00:00
2026-08-15 22:20:30 -07:00
2026-09-26 18:57:53 -04:00
2026-09-22 14:57:52 -04:00
2026-10-01 00:37:03 +00:00
2026-09-29 06:07:35 -07:00