mirror of
https://github.com/garrytan/gstack.git
synced 2026-11-11 03:00:26 +01:00
fix(qa): an invalid-input probe breaks only the rule it tests
The paid gate's qa-functional-cli-report failed again on #3236 (run 39001107574): the agent probed the digits-only amount rule with -5, which the positivity check rejected first, so the planted parseInt defect stayed hidden and it reported no defect. The contract map's invalid-input row now asks for each input to break only the rule it tests, so another check cannot reject it first. Co-authored-by: capy-ai[bot] <230910855+capy-ai[bot]@users.noreply.github.com>
This commit is contained in:
1 parent
79554ccaba
commit
c2eb035551
2 files changed
+2
-2
No files matched your search
@@ -30,7 +30,7 @@ pass/fail/blocked/not run/inconclusive/not applicable (reason).
|
||||
| Contract | Observe |
|
||||
|---|---|
|
||||
| Successful execution | Expected return/output and final business effect, not just launch/acceptance |
|
||||
| Invalid/missing input | One probe per documented input rule (allowed characters, format, sign, range, arity): declared rejection, correct status and no forbidden state change |
|
||||
| Invalid/missing input | One probe per documented input rule (allowed characters, format, sign, range, arity), each input breaking only that rule so no other check rejects it first: declared rejection, correct status and no forbidden state change |
|
||||
| Authentication/authorization | Valid identity, missing/invalid identity, wrong owner/role and durable no-effect boundary |
|
||||
| CLI process contract | Exact exit code, stdout and stderr separately; resulting file/state changes |
|
||||
| State transitions | Initial, intermediate and completed/failed states and their permitted transitions |
|
||||
|
||||
@@ -185,7 +185,7 @@ pass/fail/blocked/not run/inconclusive/not applicable (reason).
|
||||
| Contract | Observe |
|
||||
|---|---|
|
||||
| Successful execution | Expected return/output and final business effect, not just launch/acceptance |
|
||||
| Invalid/missing input | One probe per documented input rule (allowed characters, format, sign, range, arity): declared rejection, correct status and no forbidden state change |
|
||||
| Invalid/missing input | One probe per documented input rule (allowed characters, format, sign, range, arity), each input breaking only that rule so no other check rejects it first: declared rejection, correct status and no forbidden state change |
|
||||
| Authentication/authorization | Valid identity, missing/invalid identity, wrong owner/role and durable no-effect boundary |
|
||||
| CLI process contract | Exact exit code, stdout and stderr separately; resulting file/state changes |
|
||||
| State transitions | Initial, intermediate and completed/failed states and their permitted transitions |
|
||||
|
||||
Reference in new issue
Block a user