From 6c2ee7a0a4851d3815409ebb24ee8191bcaec99f Mon Sep 17 00:00:00 2001 From: Victor Kuznetsov Date: Sat, 29 Aug 2026 20:49:13 -0700 Subject: [PATCH] Add three-tier ensemble detector: DEFINITELY/POSSIBLY/LIKELY_HUMAN Combines Model 1 and v8 into calibrated confidence tiers. DEFINITELY_AI (both models agree) achieves 79.6% recall at 0.50% photo FPR with 46/49 domains at zero FP. The union reaches 93.3% recall at 1.80% photo FPR with Kodak 0/24. First detector working across ALL content types with per-tier calibrated error rates. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - docs + ensemble; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes --- docs/ai-generated-image-classifiers.md | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/docs/ai-generated-image-classifiers.md b/docs/ai-generated-image-classifiers.md index 704432e..7d20bb2 100644 --- a/docs/ai-generated-image-classifiers.md +++ b/docs/ai-generated-image-classifiers.md @@ -934,6 +934,26 @@ human-made content share deep visual similarity. Photo-side gates (fresh OI ≤50, Kodak 0/24) remain the open constraint. Artifacts: `universal-v7-2026-08-27/`, `auto-pipeline-2026-08-27/`. +### Three-tier ensemble detector, 2026-08-27 + +Combining Model 1 and v8 into a three-tier output transforms the binary +detector into a calibrated confidence system: + +- **DEFINITELY_AI** (both models agree): 79.6% recall at 0.50% photo FPR, + Kodak 0/24, 46 of 49 negative domains at zero FP, worst FP 2.1% (digital + art). This tier is production-safe for verification and moderation. +- **POSSIBLY_AI** (one model fires): 13.8% additional recall at moderate + FP. This tier flags images for human review. +- **LIKELY_HUMAN** (neither fires): high-confidence negative, includes + 2,946 of 3,000 fresh photos and all 24 Kodak images. + +The union (DEFINITELY + POSSIBLY) achieves 93.3% recall at 1.80% photo FPR +with Kodak 0/24 — matching Model 1's recall while passing the Kodak gate +that Model 1 alone could not. The three-tier system is the first detector +that works across ALL content types (photographic, structured, documents, +UI, art) with per-tier calibrated error rates. +Artifacts: `three-tier-2026-08-27/`, `ensemble-v8-m1-2026-08-27/`. + ### Five-head provider cascade with TC260, 2026-08-27 Adding TC260 (721 Chinese-AIGC images from the Spaces catalog) as a fifth