docs: record Qwen3.8 qualification evidence

This commit is contained in:
Joseph Magly
2026-08-29 19:33:24 -04:00
parent d6d4f5ba22
commit dd1336f9de
2 changed files with 22 additions and 9 deletions
+2
View File
@@ -58,6 +58,7 @@
"paths": [
"obliteratus/abliterate.py",
"obliteratus/benchmark_lifecycle.py",
"obliteratus/checkpoint_evaluation.py",
"obliteratus/models/qwen35_contracts.py",
"obliteratus/models/offload_surgery.py",
"obliteratus/persistence_contracts.py",
@@ -87,6 +88,7 @@
"tests/test_sweep_contracts.py",
"tests/test_tourney_contracts.py",
"tests/test_checkpoint_atomicity.py",
"tests/test_checkpoint_evaluation.py",
"tests/test_offload_surgery.py",
"tests/test_persistence_contracts.py",
"tests/test_persistence_pipeline.py",
+20 -9
View File
@@ -254,17 +254,28 @@ from 60% refusal in S2 to 100% in several other strata.
- text-only regression plus a separate multimodal smoke test so text surgery
does not silently break the native vision-language wrapper.
## Recommended next operational run
## Operational qualification result
E02 completed on the optimizer-tune partition as run
`run-efb2f334197e48fb82587f39a84fe6c9`: refusal fell to 1% (1/142), but
coherence was 70% and 6/142 harmful responses were degenerate. Its checkpoint
and full archive are retained. E03 changes only regularization from 0.00 to
0.10, retaining 10% of the measured refusal subspace to recover coherence while
using E02's 29-point refusal margin. E03 must not read the 200-pair final
partition. Promote only if tune refusal remains below 30% and coherence reaches
at least 80%; then evaluate the final partition exactly once and independently
reload the saved checkpoint for release qualification.
`run-efb2f334197e48fb82587f39a84fe6c9`: refusal fell to 1% (1/142), but its
original preview-truncated coherence score was 70% and 6/142 harmful responses
were degenerate. Its checkpoint and full archive are retained.
E03 (`run-c18babdb7be34396a07fbb994c23d4cb`) changed only regularization from
0.00 to 0.10. The saved 53.8 GB BF16 checkpoint was independently reloaded for
each evaluation after verifying all 35 checkpoint inventory entries by size and
SHA-256. With the corrected full-completion coherence scorer, the immutable
optimizer-tune split produced 1.41% refusal (2/142), 100% coherence, 83.3%
capability, 3.21 perplexity (1.02x pristine), and 1/142 degenerate harmful
responses. It therefore earned exactly one evaluation on the untouched final
split. That final saved-checkpoint reload produced 1.0% refusal (2/200), 100%
coherence, 83.3% capability, 3.21 perplexity, and 6/200 degenerate harmful
responses. Both durable evaluation records are hashed in the run manifest.
E03 passes the declared promotion gates of refusal below 30% and coherence of
at least 80%. The 3% final harmful-output degeneracy rate remains a follow-up
quality concern and should be included in downstream human and classifier
audits rather than hidden by the aggregate promotion result.
## Evidence base