Garry Tan and capy-ai[bot]
91ddd3bdb1
fix(evals): the Codex removed-rule arm really removes the rule from installed skills (GST-840) ( #3816 )
...
* fix(evals): Codex removed-rule arm strips the rule from the installed skills (GST-840)
Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
* fix(evals): copy linked directories inside a skill before stripping the rule; record the harness decision (GST-840)
/ship review found readdirSync({ recursive: true }) follows linked
subdirectories, so a rule file under a linked directory inside a real
skill directory would have been deleted and rewritten in the checkout.
Every linked directory on the way to a rule file is now copied first,
with a failing-first test row. The harness-version manifest records
codex-host-runner.ts as non-behavioral: only the manual removed arm
on the Codex host changes.
Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
* test: keep the Codex safety-arm test off Windows, and spawn its probe with bunIsolationArgs (GST-840)
windows-free-shard 3 (run 41336347706) failed every case: native Bun on
Windows cannot open --config=/dev/null, and the test builds a symlinked
~/.codex/skills install that needs Developer Mode the runners lack.
./setup --host codex copies instead of linking on Windows, so the strip
only matters on POSIX. The probe now uses bunIsolationArgs().
Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
---------
Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
2026-11-05 00:29:18 +00:00
..
2026-10-31 05:53:14 +00:00
2026-11-02 17:44:00 +00:00
2026-11-02 17:44:00 +00:00
2026-10-19 18:26:20 +00:00
2026-10-31 22:41:36 +00:00
2026-10-31 22:41:36 +00:00
2026-09-06 08:54:25 -07:00
2026-11-02 17:44:00 +00:00
2026-09-25 13:27:07 -04:00
2026-10-27 13:28:18 +00:00
2026-10-06 18:07:50 +00:00
2026-09-22 14:57:52 -04:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-09-22 14:57:52 -04:00
2026-11-03 02:08:50 +00:00
2026-11-02 01:35:47 +00:00
2026-10-11 19:09:12 +00:00
2026-10-08 17:40:06 +00:00
2026-11-04 23:59:00 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-11-04 03:33:48 +00:00
2026-11-02 01:35:47 +00:00
2026-09-05 14:45:28 -07:00
2026-09-09 08:57:21 -07:00
2026-10-31 05:53:14 +00:00
2026-09-29 06:07:35 -07:00
2026-10-03 18:49:34 -07:00
2026-10-05 01:29:54 +00:00
2026-08-27 09:50:31 -07:00
2026-08-31 08:55:30 -07:00
2026-10-14 17:36:39 +00:00
2026-11-03 19:39:32 +00:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-10-04 07:58:41 -07:00
2026-10-01 13:55:16 -07:00
2026-10-04 07:58:41 -07:00
2026-10-01 13:55:16 -07:00
2026-10-06 18:07:50 +00:00
2026-10-06 18:07:50 +00:00
2026-10-27 13:28:18 +00:00
2026-10-01 11:57:48 -07:00
2026-10-23 18:35:59 +00:00
2026-10-01 11:57:48 -07:00
2026-11-02 17:44:00 +00:00
2026-10-01 11:57:48 -07:00
2026-11-01 15:47:35 +00:00
2026-09-22 14:57:52 -04:00
2026-11-01 15:47:35 +00:00
2026-10-23 18:35:59 +00:00
2026-10-03 18:49:34 -07:00
2026-10-19 18:26:20 +00:00
2026-11-05 00:29:18 +00:00
2026-10-06 18:07:50 +00:00
2026-10-07 23:29:05 +00:00
2026-10-19 18:26:20 +00:00
2026-10-25 23:39:42 +00:00
2026-11-04 22:19:08 +00:00
2026-11-02 15:08:48 +00:00
2026-10-03 07:54:09 -07:00
2026-09-29 08:58:49 -07:00
2026-09-25 12:06:45 -04:00
2026-10-06 10:32:19 -07:00
2026-10-25 07:03:51 +00:00
2026-10-03 01:19:03 -07:00
2026-11-02 15:08:48 +00:00
2026-10-22 20:10:23 +00:00
2026-11-03 22:44:59 +00:00
2026-10-20 18:45:38 +00:00
2026-10-27 08:16:11 +00:00
2026-10-28 19:09:45 +00:00
2026-11-04 23:59:00 +00:00
2026-10-22 20:10:23 +00:00
2026-11-02 14:49:46 +00:00
2026-09-14 14:32:45 -07:00
2026-10-05 01:29:54 +00:00
2026-10-05 01:29:54 +00:00
2026-11-02 17:44:00 +00:00
2026-10-27 08:16:11 +00:00
2026-08-24 08:55:58 -07:00
2026-10-25 07:15:55 +00:00
2026-10-06 18:07:50 +00:00
2026-11-04 22:19:08 +00:00
2026-10-06 18:07:50 +00:00
2026-11-02 17:44:00 +00:00
2026-10-18 01:37:29 +00:00
2026-10-18 01:37:29 +00:00
2026-10-31 22:41:36 +00:00
2026-09-14 14:32:45 -07:00
2026-10-11 16:33:10 +00:00
2026-11-03 14:14:50 +00:00
2026-10-01 13:55:16 -07:00
2026-09-22 14:57:52 -04:00
2026-11-04 23:35:57 +00:00
2026-11-04 23:59:00 +00:00
2026-10-31 04:53:38 +00:00
2026-08-28 11:43:13 -07:00
2026-10-10 22:33:01 +00:00
2026-10-19 07:26:49 +00:00
2026-10-06 23:42:19 +00:00
2026-10-25 12:14:02 +00:00
2026-11-02 23:05:47 +00:00
2026-10-02 11:11:00 -07:00
2026-10-04 07:58:41 -07:00
2026-10-14 17:36:39 +00:00
2026-09-22 14:57:52 -04:00
2026-11-01 14:23:49 +00:00
2026-10-26 06:41:22 +00:00
2026-10-03 18:49:34 -07:00
2026-10-07 23:29:05 +00:00
2026-11-04 22:19:08 +00:00
2026-11-04 22:19:08 +00:00
2026-10-31 22:41:36 +00:00
2026-10-01 11:57:48 -07:00
2026-10-07 23:29:05 +00:00
2026-10-31 22:41:36 +00:00
2026-10-05 01:29:54 +00:00
2026-10-05 01:29:54 +00:00
2026-10-19 21:55:24 +00:00
2026-10-19 21:55:24 +00:00
2026-10-04 07:58:41 -07:00
2026-09-29 06:07:35 -07:00
2026-09-14 14:32:45 -07:00
2026-10-06 18:07:50 +00:00
2026-10-06 18:07:50 +00:00
2026-10-06 18:07:50 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-05 01:29:54 +00:00
2026-10-28 00:27:22 +00:00
2026-10-31 05:53:14 +00:00
2026-11-03 15:04:56 +00:00
2026-11-03 01:40:07 +00:00
2026-09-24 01:53:58 -04:00
2026-10-23 18:35:59 +00:00
2026-10-03 07:54:09 -07:00
2026-09-14 14:32:45 -07:00
2026-09-24 01:53:58 -04:00
2026-09-22 14:57:52 -04:00
2026-10-04 07:58:41 -07:00
2026-10-04 07:58:41 -07:00
2026-10-19 07:26:49 +00:00
2026-09-14 14:32:45 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 01:19:03 -07:00
2026-11-04 23:59:00 +00:00
2026-09-29 08:58:49 -07:00
2026-10-01 13:55:16 -07:00
2026-09-14 14:32:45 -07:00
2026-10-01 13:55:16 -07:00
2026-09-22 14:57:52 -04:00
2026-10-06 23:42:19 +00:00
2026-09-22 14:57:52 -04:00
2026-11-01 06:11:17 +00:00
2026-11-05 00:01:33 +00:00
2026-10-11 03:10:06 +00:00
2026-10-03 07:54:09 -07:00
2026-10-05 01:29:54 +00:00
2026-10-06 18:07:50 +00:00
2026-10-01 11:57:48 -07:00
2026-09-14 14:32:45 -07:00
2026-10-20 18:23:57 +00:00
2026-11-03 01:40:07 +00:00
2026-10-03 18:49:34 -07:00
2026-10-20 00:24:28 +00:00
2026-10-26 16:55:25 +00:00
2026-10-04 07:58:41 -07:00
2026-10-16 23:09:23 +00:00
2026-10-03 01:19:03 -07:00
2026-10-31 04:53:38 +00:00
2026-10-03 18:49:34 -07:00
2026-10-21 18:11:21 +00:00
2026-09-29 08:58:49 -07:00
2026-09-29 08:58:49 -07:00
2026-11-02 23:05:47 +00:00
2026-08-29 09:06:54 -07:00
2026-08-29 09:06:54 -07:00
2026-10-31 22:41:36 +00:00
2026-10-31 22:41:36 +00:00
2026-10-31 22:41:36 +00:00
2026-11-05 00:22:40 +00:00
2026-10-31 22:41:36 +00:00
2026-10-07 23:29:05 +00:00
2026-09-29 08:58:49 -07:00
2026-11-02 17:44:00 +00:00
2026-09-29 06:07:35 -07:00
2026-11-02 17:44:00 +00:00
2026-09-23 08:54:53 -04:00
2026-11-02 17:44:00 +00:00
2026-11-01 14:23:49 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-01 13:55:16 -07:00
2026-11-02 23:05:47 +00:00
2026-10-19 07:26:49 +00:00
2026-09-29 06:07:35 -07:00
2026-10-04 07:58:41 -07:00
2026-09-24 01:53:58 -04:00
2026-10-29 00:16:09 +00:00
2026-10-31 07:22:56 +00:00
2026-11-01 16:01:55 +00:00
2026-11-02 12:06:35 +00:00
2026-10-31 04:53:38 +00:00
2026-10-06 23:42:19 +00:00
2026-10-29 00:01:37 +00:00
2026-11-02 03:23:35 +00:00
2026-11-02 03:23:35 +00:00
2026-09-29 06:07:35 -07:00
2026-10-03 01:19:03 -07:00
2026-10-03 01:19:03 -07:00
2026-10-28 00:27:22 +00:00
2026-10-03 01:19:03 -07:00
2026-11-03 19:49:58 +00:00
2026-11-03 01:40:07 +00:00
2026-09-22 14:57:52 -04:00
2026-10-27 13:47:00 +00:00
2026-09-22 14:57:52 -04:00
2026-10-17 03:32:16 +00:00
2026-10-05 01:29:54 +00:00
2026-09-22 14:57:52 -04:00
2026-09-22 14:57:52 -04:00
2026-10-01 13:55:16 -07:00
2026-10-01 13:55:16 -07:00
2026-10-31 10:08:55 +00:00
2026-10-03 01:19:03 -07:00
2026-11-01 16:01:55 +00:00
2026-09-06 08:54:25 -07:00
2026-09-29 08:58:49 -07:00
2026-11-04 22:19:08 +00:00
2026-08-15 22:20:30 -07:00
2026-11-01 21:11:44 +00:00
2026-10-03 07:54:09 -07:00
2026-11-01 16:01:55 +00:00
2026-10-19 07:26:49 +00:00
2026-10-03 01:19:03 -07:00
2026-11-04 22:19:08 +00:00