Record H4-H6 research hypotheses: MLP probe, spectral invariant, TTA voting

H4 (MLP on frozen CLIP): 98.6% AI-test recall but 15.8% photo FPR — same
trade-off curve as quarter-hard. H5 (spectral invariant from CVPR 2025):
2.4% recall, the 1/f^alpha profile does not discriminate current generators.
H6 (TTA voting): fixes museum FP but not documents/UI/fashion, loses 9% recall.
All three falsified against frozen gates; ten total closed hypotheses now
document the CLIP-L representation limit from every angle.

Also records the provider cascade across all 20 domains (69.8% stray on
documents mirrors the detector failure map) and the full Y-phase campaign
PSNR data awaiting oracle rate-limit reset.

pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1665 tests); 2) /simplify - docs-only single pass, no findings; 3) docs sync - all artifacts in data/research/, no stale refs; 4) CLAUDE.md - no changes
This commit is contained in:
Victor Kuznetsov
2026-08-27 23:16:08 -07:00
parent 04f0121ab5
commit 0f662f8d43
+46
View File
@@ -847,6 +847,52 @@ reopening would require 10+ diverse generators in training or a
fundamentally different feature space that captures what AI generation
processes share beyond their decoder-specific artifacts.
### Provider cascade across all 20 domains, 2026-08-27
The frozen provider cascade (margin 0.50) was scored on every measured
negative and positive domain. Photo negatives are quiet (COCO 0.7% stray,
Kodak 0%), museum/modern/stock cells leak 2.9-11.9% into `google` (mostly
stylized content that pattern-matches Imagen), but documents are the
exception: **69.8% of document/receipt content receives a stray provider
call** (48 openai, 19 google out of 96), and batch-2 content (memes, tickets,
whiteboards, book pages) leaks 27.0% (35 google calls out of 137). Wild AI
leans google at 15.1% with only 1 openai call. The provider cascade is
therefore safe on photographic content, partially safe on stylized content,
and unsafe on document-like content — mirroring the Model 1 failure map. A
production integration of the provider layer must gate on the same
photographic-content condition as the detector itself.
Artifacts: `provider-all-domains-2026-08-27/report.json`.
### Research-driven hypotheses H4-H6, 2026-08-27
Three approaches from 2025 literature (C2P-CLIP prompt learning from AAAI,
spectral invariant from CVPR, TTA voting) were run against the frozen gates.
**H4 (MLP prompt-probe on frozen CLIP, C2P-CLIP inspired):** a two-layer
MLP trained on frozen CLIP-L embeddings improves AI-test recall to
1,878/1,905 (98.6%, gate passed) and FLUX to 298/300, but at the cost of
fresh Open Images 473/3,000 (15.8% FPR, gate failed) and Kodak 6/24. The
nonlinear head trades photo safety for recall — same direction as quarter-hard
but via MLP instead of continuation. Gates: 2/4 passed.
**H5 (spectral invariant, CVPR 2025):** radial power-spectrum deviation from
a camera-image reference detected only 7/297 AI-test (2.4%) and 1/300 FLUX.
The 1/f^alpha spectral profile does not discriminate current AI generators
from camera photos at any useful operating point. Gates: 0/4 passed.
**H6 (TTA voting, 6 views):** averaging scores over center + 4 corners + flip
preserves photo gates (fresh 5/300, Kodak 0/24) but reduces AI-test from
273→264 and does not rescue any negative domain: documents still 65/80 FP,
batch1 80/80, museum drops to 1/80 but fashion stays 14/80. TTA helps museum
but hurts everything else. Gates: 2/4 passed (AI-test and fresh marginally,
Kodak and FLUX lost).
All three hypotheses are closed. The H4 MLP is the strongest non-continuation
result (98.6% AI-test recall from frozen embeddings) but fails the photo
contract, consistent with every previous finding: CLIP-L encodes appearance,
not provenance, and no head on top of it can satisfy both contracts
simultaneously.
The combined-pool control then separated the data question from the geometry
question: refitting the same pooled/domain/multiclass ridge vetoes on a
687-row modern-negative pool (Openverse-clean plus all three stock cells,