mirror of
https://github.com/wiltodelta/remove-ai-watermarks.git
synced 2026-08-31 17:50:35 +02:00
Add three-tier ensemble detector: DEFINITELY/POSSIBLY/LIKELY_HUMAN
Combines Model 1 and v8 into calibrated confidence tiers. DEFINITELY_AI (both models agree) achieves 79.6% recall at 0.50% photo FPR with 46/49 domains at zero FP. The union reaches 93.3% recall at 1.80% photo FPR with Kodak 0/24. First detector working across ALL content types with per-tier calibrated error rates. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - docs + ensemble; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes
This commit is contained in:
@@ -934,6 +934,26 @@ human-made content share deep visual similarity. Photo-side gates (fresh OI
|
||||
≤50, Kodak 0/24) remain the open constraint.
|
||||
Artifacts: `universal-v7-2026-08-27/`, `auto-pipeline-2026-08-27/`.
|
||||
|
||||
### Three-tier ensemble detector, 2026-08-27
|
||||
|
||||
Combining Model 1 and v8 into a three-tier output transforms the binary
|
||||
detector into a calibrated confidence system:
|
||||
|
||||
- **DEFINITELY_AI** (both models agree): 79.6% recall at 0.50% photo FPR,
|
||||
Kodak 0/24, 46 of 49 negative domains at zero FP, worst FP 2.1% (digital
|
||||
art). This tier is production-safe for verification and moderation.
|
||||
- **POSSIBLY_AI** (one model fires): 13.8% additional recall at moderate
|
||||
FP. This tier flags images for human review.
|
||||
- **LIKELY_HUMAN** (neither fires): high-confidence negative, includes
|
||||
2,946 of 3,000 fresh photos and all 24 Kodak images.
|
||||
|
||||
The union (DEFINITELY + POSSIBLY) achieves 93.3% recall at 1.80% photo FPR
|
||||
with Kodak 0/24 — matching Model 1's recall while passing the Kodak gate
|
||||
that Model 1 alone could not. The three-tier system is the first detector
|
||||
that works across ALL content types (photographic, structured, documents,
|
||||
UI, art) with per-tier calibrated error rates.
|
||||
Artifacts: `three-tier-2026-08-27/`, `ensemble-v8-m1-2026-08-27/`.
|
||||
|
||||
### Five-head provider cascade with TC260, 2026-08-27
|
||||
|
||||
Adding TC260 (721 Chinese-AIGC images from the Spaces catalog) as a fifth
|
||||
|
||||
Reference in New Issue
Block a user