Files
gstack/test/spec-template-sync.test.ts
T
Garry TanandClaude Fable 5 710900bd51 test: full suite runs as N shard processes; scrub spec-sync child env
Two fixes from the wedge-hunt endgame:

1. Full-suite mode switches from one 'bun test --parallel' invocation to
   N concurrent shard PROCESSES, serial within each (the paid runner's
   proven model; N = min(6, cpus-2)). The single-invocation strategy hit
   three distinct Bun 1.3.13 worker pathologies in one day — a segfault
   whose crashed-worker retry wedged the run, a quarantined file's
   still-running file-level hooks stalling a worker, and spawn-heavy
   files hanging under load — and each one stalled the WHOLE invocation.
   Process shards isolate any wedge to its own shard. First full run
   under this model: no wedge, six epilogues, one real failure named.
   WORKER_HOSTILE stays as the paper trail; --parallel remains available
   per-shard for a future Bun.

2. That one real failure: spec-template-sync regenerates SKILL.md via a
   child that inherited the shard process's env — an earlier test's
   GSTACK_*/GBRAIN_* mutations changed generator output (failed in-suite,
   passed solo on an identical tree). The child now gets a scrubbed env:
   generator output must be a function of the templates, not of whichever
   test ran before.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-08-15 15:43:33 -07:00

46 lines
1.7 KiB
TypeScript

/**
* spec-template-sync: verify spec/SKILL.md.tmpl ↔ spec/SKILL.md stay in sync.
*
* Per codex T8 / eng plan: regen and assert no drift. Catches commits that
* edit the template but forget to run `bun run gen:skill-docs`, or vice versa.
*/
import { describe, test, expect } from 'bun:test';
import * as fs from 'fs';
import * as path from 'path';
import { spawnSync } from 'child_process';
const ROOT = path.resolve(import.meta.dir, '..');
describe('/spec template/generated sync', () => {
test('regenerating spec/SKILL.md produces byte-identical output', () => {
const generatedPath = path.join(ROOT, 'spec', 'SKILL.md');
const before = fs.readFileSync(generatedPath);
const res = spawnSync('bun', ['run', 'gen:skill-docs'], {
cwd: ROOT,
encoding: 'utf-8',
timeout: 120_000,
// Scrubbed env: bun test runs a shard's files serially in ONE process,
// so an earlier test's env mutations (GSTACK_*/GBRAIN_* detection vars)
// leak into inherited process.env and change generator output — this
// test failed in-suite while passing solo on an identical tree. The
// generator's output must be a function of the templates, not of
// whichever test ran before this one.
env: {
PATH: process.env.PATH ?? '',
HOME: process.env.HOME ?? '',
TMPDIR: process.env.TMPDIR ?? '',
},
});
expect(res.status).toBe(0);
const after = fs.readFileSync(generatedPath);
expect(after.equals(before)).toBe(true);
}, 130_000);
test('spec/SKILL.md is auto-generated header is present', () => {
const generated = fs.readFileSync(path.join(ROOT, 'spec', 'SKILL.md'), 'utf-8');
expect(generated).toMatch(/AUTO-GENERATED|do not edit directly/i);
});
});