CalvinBackup/OBLITERATUS
1
0
Fork 0
mirror of https://github.com/elder-plinius/OBLITERATUS.git synced 2026-08-17 16:37:30 +02:00
Code Issues Packages Projects Releases Wiki Activity

docs: reconcile Gate 3 item 4 evidence

Browse Source
This commit is contained in:
Joseph Magly
2026-08-16 03:06:46 -04:00
parent d7d2ad566a
commit 75219a0db3
2 changed files with 34 additions and 26 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.aiwg/testing/gate3-increment-4-report.md
+25 -17
View File
@@ -1,36 +1,35 @@
# Gate 3 increment 4 checkpoint reliability report
Date: 2026-08-15
Date: 2026-08-16
Exact base: `c1b34503ddd3cb797e5d70671c47afcabfe73832`
Exact core implementation/mutation head:
`9da022e6f3bc73d17fd31d4da70b42e3ca052ba2`
Windows durability repair commit:
`2771dd42cacec3e137804f0ba0e1b12c5d611c0d`
Delivery head: the containing documentation and Windows-CI commit, resolved with
`git rev-parse HEAD`
Canonical merge: pending
Status: PASS locally; repaired hosted Windows contract, exact-head audit, and
merge pending
Delivery head: `6be6b01ad7a9b4c4fc52280b49f3488e2f8ba98d`
Canonical merge: `d7d2ad566af778b1d315616bbea8b8a3c4dd2191` (PR #104)
Status: PASS; exact-head audit, rebase merge, and canonical post-merge evidence
complete
## Results
| Gate | Result |
|---|---|
| Focused checkpoint/policy contracts | 176 passed in 6.08s at the exact core head; the repaired delivery tree passed 180 tests in 6.47s |
| Mandatory CPU matrix | Exact core head — Python 3.10: 1,878 passed in 88.21s; Python 3.11: 1,878 passed in 80.63s. Repaired delivery tree — Python 3.12: 1,881 passed, 2 expected xfails in 54.51s. Nine conditional tests were deselected on each interpreter |
| Repository coverage | 76.60% statements / 63.25% branches before; 76.77% / 63.56% after |
| Mandatory CPU matrix | Exact core head — Python 3.10: 1,878 passed in 88.21s; Python 3.11: 1,878 passed in 80.63s. Repaired delivery tree — Python 3.12: 1,881 passed, 2 expected xfails in 54.51s. Canonical post-merge Python 3.12: 1,883 passed in 84.84s with no failures, errors, or skips. Nine conditional tests remained deselected by policy |
| Repository coverage | Canonical exact-base 76.59% statements / 63.17% branches; canonical merge 76.76% / 63.49% |
| Mature CPU scope | 93.12% statements / 82.60% branches before; 93.20% / 82.86% after |
| Changed executable lines | 143/143 (100%) against the exact base on Python 3.12 |
| Touched production modules | 2/2 pass exact-base line and branch no-regression |
| Persistence seam | `persistence_contracts.py`: 100% statements and 100% branches (171 statements, 60 branches) |
| Abliteration runtime | 50.82% statements / 38.03% branches before; 50.91% / 38.03% after |
| Selective mutation | 1,614/1,827 killed (88.34%); 208 survived; 5 timed out; 0 no-test, suspicious, skipped, interrupted, or segfault results |
| Selective mutation | Canonical post-merge: 1,618/1,831 killed (88.37%); 208 survived; 5 timed out; 0 no-test, suspicious, skipped, interrupted, or segfault results |
| Changed persistence mutation | Exact core head: 229/229 killed. Repaired delivery tree: 233/233 killed; 0 survived or timed out |
| Mutation runtime | 920.27s; 1,121,616 KiB maximum parent RSS; required-target guard passed |
| Repeatability | 493 tests passed in each of three file orders/hash seeds; 33.832s total; no flake candidates or consistent failures |
| Mutation runtime | Canonical post-merge: 2,043.17s; 624,932 KiB maximum parent RSS; required-target guard passed |
| Repeatability | Canonical post-merge: 497 tests passed in each of three file orders/hash seeds; 47.315s total; no flake candidates or consistent failures |
| Package | sdist and wheel built; metadata, contents, isolated import, version, module entry point, and console entry point passed on Python 3.12 |
| Supply chain | Pinned `uv 0.12.4` lock, all-extras import, Gitleaks, Python 3.10–3.12 vulnerability audits, wheel-bound CycloneDX SBOM, and license policy passed |
| Windows portability | The first hosted lane correctly blocked delivery after exposing `os.O_RDONLY` as an invalid Windows `_commit`/`fsync` handle (23 failed, 62 passed). The repaired selector uses `O_RDWR | O_BINARY` on Windows and `O_RDONLY` elsewhere; second exact-head result pending |
| Windows portability | The first hosted lane correctly blocked delivery after exposing `os.O_RDONLY` as an invalid Windows `_commit`/`fsync` handle (23 failed, 62 passed). The repaired selector uses `O_RDWR | O_BINARY` on Windows and `O_RDONLY` elsewhere; the final exact-head and canonical post-merge Windows lanes each passed all 89 contracts |
The mandatory Python lanes remain below the 240-second policy budget. The final
Python 3.12 test time measured 1.06s faster than the exact-base 55.57s while
@@ -111,7 +110,15 @@ ownership, and offload-directory ownership loss.
- Exact core-head mutation evidence:
`/tmp/obliteratus-gate3-item4-mutation-PVKKOL/`
- Repaired delivery-tree persistence mutation: 233/233 killed from prepared
local `mutants/` evidence; hosted aggregate quality-depth evidence pending
local `mutants/` evidence
- Canonical post-merge Python 3.12 evidence:
`/tmp/obliteratus-postmerge-item4-py312-CH4T03/`
- Canonical post-merge repeat and mutation evidence:
`/tmp/obliteratus-postmerge-item4-quality-5yrGKB/`
- Canonical hosted run:
https://github.com/elder-plinius/OBLITERATUS/actions/runs/31926709748
- Exact-head audit:
https://github.com/elder-plinius/OBLITERATUS/pull/104#issuecomment-5305717315
- Python 3.10/3.11 and quality-depth normalized trends:
`/tmp/obliteratus-gate3-item4-trends-lrrEjF/`
- Package evidence:
@@ -135,7 +142,8 @@ a checkpoint portability contract, not a claim that accelerator, MPS, MLX,
network, download, remote, or operator-UI execution is supported by this
increment.
Delivery requires the containing commit to be pushed, pass the repaired hosted
Windows checkpoint run and all existing required checks, be audited at its
exact final SHA with no unresolved review thread, and be rebase merged before
item 5 begins.
Delivery completed at canonical commit
`d7d2ad566af778b1d315616bbea8b8a3c4dd2191`. The exact final head passed all
eight hosted jobs, had no unresolved review thread, received a clean exact-SHA
audit, and was rebase merged. The canonical post-merge run then passed the same
eight jobs on attempt 1 before item 5 began.
.aiwg/testing/master-test-plan.md
+9 -9
View File
@@ -293,12 +293,12 @@ resistance, environment evidence, or deterministic replay.
| Measure | Current | Gate 3 minimum |
|---|---:|---:|
| Repository statements | 76.77% candidate | 80.00% |
| Repository branches | 63.55% candidate | 65.00% |
| Mature CPU statements | 93.19% candidate | 94.00% |
| Mature CPU branches | 82.85% candidate | 84.00% |
| Repository statements | 76.76% canonical | 80.00% |
| Repository branches | 63.49% canonical | 65.00% |
| Mature CPU statements | 93.20% canonical | 94.00% |
| Mature CPU branches | 82.86% canonical | 84.00% |
| Changed executable lines | 95.00% floor | 95.00% floor |
| Selected mutation score | 88.34% candidate on expanded persistence scope | at least 85% on expanded scope |
| Selected mutation score | 88.37% canonical on expanded persistence scope | at least 85% on expanded scope |
| Unexpected warnings | 0 | 0 |
| Active flaky quarantines | 0 | 0 |
| Software conditional evidence age | at most 8 days | at most 8 days |
@@ -382,10 +382,10 @@ single repository-wide coverage PR.
3. **Completed at `c1b3450` (PR #103).** Add loader, architecture, dtype,
quantization, and shared-weight decision contracts with mutation evidence.
Canonical evidence is recorded in `gate3-increment-3-report.md`.
4. **Implemented in Gate 3 increment 4; exact-head PR audit and canonical merge
pending.** Add checkpoint failure injection, concurrency, atomicity, retry,
cleanup-ownership, and Windows portability contracts. Candidate evidence is
recorded in `gate3-increment-4-report.md`.
4. **Completed at `d7d2ad5` (PR #104).** Add checkpoint failure injection,
concurrency, atomicity, retry, cleanup-ownership, and Windows portability
contracts. Canonical evidence is recorded in
`gate3-increment-4-report.md`.
5. Add BESTIARY/model-client/watchtower transport and scheduler state contracts.
6. Add tournament, interactive, and UI decision-seam contracts.
7. Extend the installed tiny-model vertical slice and quantized-storage