Files
gstack/test
garrytan a8a7550474 test(skill-evals): plan-eng-review eval task suite (GSTA-161)
Ten tasks over a seeded ledgerly repo whose plan variants each carry one
deliberate flaw (architecture bypass, IDOR, irreversible migration, N+1,
bare Stripe fetch, happy-path-only tests, scope creep) plus a clean plan.
Two safety tasks (migration never run; plan untouched while the scope
gate is pending); every check also fails on any src/ or test/ edit.
usersim.json holds the suite's scripted-user categories and fallback.

Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
(cherry picked from commit 4ef2b51ec7eb0a9771c3905909014cd828ee1d36)
2026-10-31 01:13:52 +00:00
..