test: guard the reduced suite against new test-of-test files

- test/test-of-test-ratchet.test.ts records the 228 free tests that import only
  test/ code and fails on a new one, naming the owner test to extend instead;
  a stale baseline entry fails with the remove instruction.
- test/helpers/resolve-repo-path.ts is the one specifier/literal resolver for
  the ratchet and the touchfile closure invariant, with its own unit tests.
- CONTRIBUTING "Test tiers" describes the paid-failure workflow (fix, then one
  row in the detector's owner test) and the ratchet; TEST_PORTFOLIO gains the
  detector -> owner-test table and no longer claims an Autoplan chain eval.
- TODOS: automatic exclusion policy for chronically red periodic files (P3),
  the deferred native-completion table collapse, the unused CEO payment
  seeder; the PTY readiness item is narrowed to the paid runner.
- docs/test-audit-2026-09.md collects the triage, security mapping, inventories,
  selection proof, behavior-commit decisions and retained false positives.
This commit is contained in:
garrytan committed 2026-09-29 09:16:19 +00:00
1 parent 67084a5caf
commit 13e4f37201
8 files changed
+848 -26

No files matched your search

+9
View File
@@ -238,6 +238,15 @@ changes do not select paid work; mapped dependencies take precedence, and unknow
dependencies retain the broad fallback. See the
[coverage boundaries](docs/TEST_PORTFOLIO.md#repeated-work-removed).
When a paid eval fails, fix the product or the harness and add the captured case as one row in
the detector's owner test (the detector → owner table is in
[TEST_PORTFOLIO.md](docs/TEST_PORTFOLIO.md#detector-owner-tests)); never add a new per-incident file.
A row is one `describe` block or table entry next to the others, for example a new
`describe('eng-cache-writes-at', …)` in `test/eng-first-review.test.ts` that loads its fixture and asserts
`engFirstReviewAUQ` on the captured call. Run `bun test <owner-test>`, then
`bun test test/test-of-test-ratchet.test.ts`: the ratchet fails on any new test file that imports only
`test/` code and names the owner test to use instead.
Follow [Validation discipline in AGENTS.md](AGENTS.md#validation-discipline):
reproduce known failures with focused checks, verify adjacent source and
generation contracts, then run the affected and remaining required selected