mirror of
https://github.com/wiltodelta/remove-ai-watermarks.git
synced 2026-10-14 13:30:55 +02:00
* Add rigorous SynthID research and evaluation harness * Record SynthID cross-epoch validation results * Reset SynthID detector hypotheses to paired training * Add paired wavelet and spectral SynthID probes * Record closed-corpus SynthID detector ablations * Add registered SynthID phase probing * Add periodic SynthID tile probing * Add calibrated SynthID pixel detector * Harden scale-registered SynthID detection * Record SynthID phase and channel rescue findings * Add production SynthID routing and OpenAI verification * Reframe periodic pixel route as pipeline lattice; confirm and harden detection The frozen periodic experts read an origin-anchored generation-pipeline lattice destroyed by a crop off the tile grid, not the crop-robust SynthID mark. Route the pixel result as an experimental pipeline_lattice signal kept out of the watermark inventory, and carry the crop sensitivity in every verdict envelope. Add split-patch phase/amplitude/codeword confirmation for registered-v3, affine-lattice and cyclostationary research probes, and timeout/retry/error-taxonomy hardening for the official OpenAI verification path. * Record pipeline-lattice reframing and registered-v3 phase lock Document that the pixel route detects an origin-anchored lattice rather than the watermark, and record the registered-v3 two-pixel phase-lock measurement: a 2px diagonal crop killed all 36 tested detections (28 foreign-generator, 8 Google) with recovery only at offsets that are multiples of four. Update README, CLI, Python API, supported-signals, known-limitations, module-internals, the SynthID reference, and the detector research plan. * Split SynthID campaign docs by detector, classifiers, and removal Keep Model 1 as a research AI-versus-camera result outside the library. Retire the mixed oracle-ladders page to a routing hub and mark the plan file as a chronological archive. * Keep 2026-08-22 SynthID campaign results in research docs only Drop Bayer, Model 1, and lattice re-check numbers from user guides and module internals. The library surface is unchanged. * Unplug lattice detector from package, expand research docs * Remove lattice detector sources from the public package * Document SynthID GitHub sweep findings * Document general AI classifier sweep * Document modern-negative taxonomy audit and classifier doc split Split general AI-classifier research into ai-generated-image-classifiers.md and record the modern-negative campaign: Unsplash/Openverse date-clean cells, contamination controls, quarter-hard paired result, closed linear veto and taxonomy-continuation arms. pre-commit: 1) maintain.sh - exit 1, known uv-secure lightning advisory with no upstream fix (same triage as main); core checks separately green (ruff, format, pyright, 1564 tests); 2) /simplify - docs-only single pass, no findings; 3) docs sync - split references updated everywhere, none stale; 4) CLAUDE.md - routing line already updated, compliant * Record wild-AI audit, Meta provider class, and stock-negative expansion The wild vendor-flagged AI cell (300 stratified rows) puts Model 1 recall at 69.7% on unknown-renderer stock AI; the stock-negative harvest triples the modern fashion/product cells and confirms the combined-pool veto control; the Meta muse-image corpus doubles to 132 rows with its margin sweep; a per-channel cv2 reference fixes the latent fold test under cv2 4.10.0. pre-commit: 1) maintain.sh - exit 1, known uv-secure lightning advisory with no upstream fix; core checks separately green (ruff, format, pyright, 1665 tests); 2) /simplify - docs-only single pass, no findings; 3) docs sync - new run references point at the gitignored research store, none stale; 4) CLAUDE.md - compact, no changes needed * Close representation-change campaign: both candidates falsified Pre-registered gates (AI-test >=1772, fresh OI <=50, Kodak 0, FLUX >=288, EvalGEN >=95) rejected DINOv2-L ridge head (1427/1847, 162/3000, 1/24, 29/300, 5/100) and the paired-reconstruction FFT tower (14/1847, 12/3000, 0/24, 0/300, 0/100; contract learned at 0.949 pairwise separation but no transfer to production generators). Campaign verdict: general classifier beyond local scale as pursued; product stays on documented remainder. pre-commit: 1) maintain.sh - exit 1, known uv-secure lightning advisory with no upstream fix; core checks green minutes ago (ruff, format, pyright, 1665 tests); 2) /simplify - docs-only single pass, no findings; 3) docs sync - verdict mirrored in data/research/REPRESENTATION-CAMPAIGN.md, no stale refs; 4) CLAUDE.md - no changes * Record full failure map, H2 router falsification, and H3 process detector closure 20 measured negative domains with batch-2 (memes, whiteboards, tickets, book pages). H2 domain router falsified: 97.9% of AI-test looks structured, every family 94-100%. H3 process detector on 369 contrastive pairs from three generators (OpenAI gpt-image-1-mini, Meta muse-image-1.0, Gemini flash-image) achieves 0.909 pairwise AUC on training pairs but transfers at AUC 0.55-0.60 to production AI; human receipts score higher than any AI family. The generator-specific spectral trace does not generalize across three generators, closing the process-trace family in its current form. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1665 tests); 2) /simplify - docs + research scripts, single pass, no findings; 3) docs sync - all artifacts in data/research/, no stale refs; 4) CLAUDE.md - no changes * Record H4-H6 research hypotheses: MLP probe, spectral invariant, TTA voting H4 (MLP on frozen CLIP): 98.6% AI-test recall but 15.8% photo FPR — same trade-off curve as quarter-hard. H5 (spectral invariant from CVPR 2025): 2.4% recall, the 1/f^alpha profile does not discriminate current generators. H6 (TTA voting): fixes museum FP but not documents/UI/fashion, loses 9% recall. All three falsified against frozen gates; ten total closed hypotheses now document the CLIP-L representation limit from every angle. Also records the provider cascade across all 20 domains (69.8% stray on documents mirrors the detector failure map) and the full Y-phase campaign PSNR data awaiting oracle rate-limit reset. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1665 tests); 2) /simplify - docs-only single pass, no findings; 3) docs sync - all artifacts in data/research/, no stale refs; 4) CLAUDE.md - no changes * Fix Y-phase frequency convention, record H4-H6 and campaign results The initial Y-phase campaign targeted FFT bins 16-32 instead of spatial periods 16-32 px (1/32 to 1/16 cycles/px). After the fix, the full-octave Y-phase scramble reproduces the known kill (not_detected at 20.5 dB on s1 at native 1122x1402). Partial sub-bands are visually invisible (42.5 dB) but stay detected: the mark is distributed across the full octave, not concentrated. Point intervention is not viable within this frequency band. H4 MLP probe: 98.6% recall, 15.8% FPR (same trade-off wall). H5 spectral invariant: 2.4% recall (1/f^alpha does not discriminate). H6 TTA voting: fixes museum FP but not documents/UI/fashion. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (1665 tests, verified minutes ago); 2) /simplify - docs-only; 3) docs sync - all artifacts synced; 4) CLAUDE.md - no changes * Add TC260 fifth class and per-class margin calibration to provider cascade Five-head cascade (openai/google/tc260/meta/no_ai): openai 68.8%, google 76.6%, tc260 63.8%, meta 71.8% mean recall at uniform margin 0.50. Per-class margins calibrated against 1.67% photo budget: openai 0.31, google 0.29, tc260 0.39, meta 0.55. TC260 test recall 71.4% at calibrated margins on 196 held-out images. Chinese-AIGC is a viable pixel class. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (verified within the hour); 2) /simplify - research script, single pass; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes * Record universal detector v3-v8: diverse training shifts the curve Fresh MLP on frozen CLIP embeddings with 49 negative domains (12,258 images) and 5,043 AI positives achieves 93.0% AI-test recall with 39/49 domains at zero false positives. Digital art FP dropped from 99.3% (Model 1) to 24.8%, fashion from 62-71% to 12%, UI from 99.3% to 12%. Photo FPR 0.7%. The improvement comes from training data diversity on frozen embeddings, not representation change (v5 fine-tune proved this by undoing the gains). Also adds .local-eval to ruff exclude so the gate covers only tracked files. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - docs + research; 3) docs sync - all artifacts in data/research/; 4) CLAUDE.md - no changes * Add three-tier ensemble detector: DEFINITELY/POSSIBLY/LIKELY_HUMAN Combines Model 1 and v8 into calibrated confidence tiers. DEFINITELY_AI (both models agree) achieves 79.6% recall at 0.50% photo FPR with 46/49 domains at zero FP. The union reaches 93.3% recall at 1.80% photo FPR with Kodak 0/24. First detector working across ALL content types with per-tier calibrated error rates. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - docs + ensemble; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes * Add provider v2: diversity training eliminates document leakage Same diversity-training insight applied to the provider cascade. Adding 3,769 structured negative features to training drops document/receipt leakage from 69.8% to 5.1%, UI from 10% to 4.3%, fashion from 5-15% to 0-3%. AI recall improves: OpenAI 84% (was 75%), Google 88.8% (was 79%). Photo leakage 1.4%. Worst regression: memes 47.9% (was 27%). pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - provider v2; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes * Add universal v11: full taxonomy, 136 domains, 124 at zero FP Master data plan mapped 148 visual domains. Massive collection (3,343 images, 73 domains from Openverse) plus gap-filler (724 images from Safebooru anime/manga) expanded training to 19,768 images across 136 negative domains. Universal v11 (MLP-512 + Model 1 ensemble): DEFINITELY 90.3% recall at 0.50% photo FPR, ANY 95.6% recall, 124/134 domains at exactly 0% FP, worst FP 13.8% (digital art). New domains opened: anime, manga, chibi, mecha, vintage photos, banknotes, newspapers, magazines, movie posters, antique maps, watercolor/oil originals, patterns, cosmetics, real estate, 3D renders, and 60+ more. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - docs + research; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes * Confirm representation limit: v12 fine-tune destroys structured FP despite 6x data Fine-tuning CLIP tower on 19,518 images achieves 95.1% standalone recall but returns to 100% FP on art/UI and 14/59 zero-FP domains (vs 124/134 for frozen v11). This is a representation property, not a data issue. Frozen CLIP + MLP (v11) is the only working architecture. Also records provider v3 trained on all negative domains. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (ruff, format, pyright, 1731 tests); 2) /simplify - docs + research; 3) docs sync - artifacts in data/research/; 4) CLAUDE.md - no changes * Document v13 plateau: 128/136 zero FP, frozen-CLIP ceiling confirmed v13 with top-plan expansion (1,169 new images) improves domain coverage to 128/136 at zero FP and reduces fashion FP to 5.3%, but DEFINITELY recall plateaus at 89.6% and art FP at 15.9%. The frozen CLIP + MLP architecture has reached its ceiling. pre-commit: 1) maintain.sh - exit 1, known lightning advisory; core green (verified minutes ago, 1731 tests); 2) /simplify - docs-only; 3) docs sync - v13 recorded; 4) CLAUDE.md - no changes * Document the 2026-08-31 photo-classifier freeze. Record the AI-versus-camera contract, Meta v3 hold-out, Flickr UI replacement, and that receipts stay out of the supported domain. * Scrub Spaces catalog details from classifier research docs * Record receipt layout-gate probe for the universal detector
244 lines
8.1 KiB
Python
244 lines
8.1 KiB
Python
"""Build non-generative spatial-fragmentation SynthID attack candidates.
|
|
|
|
The candidates combine deterministic smooth local warps with mild global
|
|
resampling, color changes, and codec round-trips. These are pixel transforms,
|
|
not semantic reconstruction or generative inpainting. Provider-oracle results
|
|
must be evaluated in a frozen batch with a source-positive control.
|
|
"""
|
|
|
|
from __future__ import annotations
|
|
|
|
import json
|
|
import logging
|
|
from dataclasses import asdict
|
|
from pathlib import Path
|
|
|
|
import click
|
|
import cv2
|
|
import numpy as np
|
|
from PIL import Image
|
|
from synthid_pixel_attack import (
|
|
jpeg_round_trip,
|
|
load_rgb,
|
|
measure,
|
|
norm_matched_noise,
|
|
resize_squeeze,
|
|
smooth_warp,
|
|
)
|
|
from synthid_v3_codebook_probe import load_v3_model, score_image
|
|
|
|
log = logging.getLogger(__name__)
|
|
|
|
|
|
def bounded_smooth_warp(
|
|
pixels: np.ndarray,
|
|
*,
|
|
max_displacement: float,
|
|
sigma: float,
|
|
seed: int,
|
|
) -> np.ndarray:
|
|
"""Apply a smooth warp whose per-axis displacement is absolutely bounded."""
|
|
if max_displacement < 0.0 or sigma <= 0.0:
|
|
raise ValueError("max_displacement must be nonnegative and sigma positive")
|
|
height, width = pixels.shape[:2]
|
|
rng = np.random.default_rng(seed)
|
|
fields: list[np.ndarray] = []
|
|
for _ in range(2):
|
|
noise = rng.normal(size=(height, width)).astype(np.float32)
|
|
field = cv2.GaussianBlur(noise, (0, 0), sigmaX=sigma, sigmaY=sigma)
|
|
maximum = float(np.max(np.abs(field)))
|
|
fields.append(np.zeros_like(field) if maximum == 0.0 else field * (max_displacement / maximum))
|
|
yy, xx = np.mgrid[:height, :width].astype(np.float32)
|
|
return cv2.remap(
|
|
pixels,
|
|
xx + fields[0],
|
|
yy + fields[1],
|
|
interpolation=cv2.INTER_LANCZOS4,
|
|
borderMode=cv2.BORDER_REFLECT_101,
|
|
)
|
|
|
|
|
|
def affine_combo(pixels: np.ndarray, *, rotation_degrees: float, zoom: float) -> np.ndarray:
|
|
"""Apply one centered rotation-and-zoom resampling operation."""
|
|
if zoom < 0.0:
|
|
raise ValueError("zoom must be nonnegative")
|
|
height, width = pixels.shape[:2]
|
|
matrix = cv2.getRotationMatrix2D(
|
|
center=((width - 1) / 2.0, (height - 1) / 2.0),
|
|
angle=rotation_degrees,
|
|
scale=1.0 + zoom,
|
|
)
|
|
return cv2.warpAffine(
|
|
pixels,
|
|
matrix,
|
|
(width, height),
|
|
flags=cv2.INTER_LANCZOS4,
|
|
borderMode=cv2.BORDER_REFLECT_101,
|
|
)
|
|
|
|
|
|
def color_nudge(
|
|
pixels: np.ndarray,
|
|
*,
|
|
brightness: float,
|
|
contrast: float,
|
|
saturation: float,
|
|
hue_degrees: float,
|
|
) -> np.ndarray:
|
|
"""Apply bounded global RGB contrast and HSV saturation/hue changes."""
|
|
rgb = pixels.astype(np.float32) / 255.0
|
|
rgb = np.clip((rgb - 0.5) * (1.0 + contrast) + 0.5 + brightness, 0.0, 1.0)
|
|
hsv = cv2.cvtColor(rgb, cv2.COLOR_RGB2HSV)
|
|
hsv[:, :, 0] = np.mod(hsv[:, :, 0] + hue_degrees, 360.0)
|
|
hsv[:, :, 1] = np.clip(hsv[:, :, 1] * (1.0 + saturation), 0.0, 1.0)
|
|
result = cv2.cvtColor(hsv, cv2.COLOR_HSV2RGB)
|
|
return np.clip(np.rint(result * 255.0), 0, 255).astype(np.uint8)
|
|
|
|
|
|
def jpeg_chain(pixels: np.ndarray, qualities: tuple[int, ...]) -> np.ndarray:
|
|
"""Apply sequential JPEG round-trips at QUALITIES."""
|
|
result = pixels
|
|
for quality in qualities:
|
|
result = jpeg_round_trip(result, quality)
|
|
return result
|
|
|
|
|
|
def build_candidates(source: np.ndarray) -> dict[str, np.ndarray]:
|
|
"""Build the frozen spatial-fragmentation ladder for SOURCE."""
|
|
candidates: dict[str, np.ndarray] = {
|
|
"control": source.copy(),
|
|
"elastic-075": smooth_warp(source, amplitude=0.75, sigma=56.0, seed=20260812),
|
|
"elastic-125": smooth_warp(source, amplitude=1.25, sigma=52.0, seed=20260813),
|
|
"bounded-100": bounded_smooth_warp(
|
|
source,
|
|
max_displacement=1.0,
|
|
sigma=56.0,
|
|
seed=20260817,
|
|
),
|
|
"bounded-180": bounded_smooth_warp(
|
|
source,
|
|
max_displacement=1.8,
|
|
sigma=56.0,
|
|
seed=20260818,
|
|
),
|
|
"bounded-280": bounded_smooth_warp(
|
|
source,
|
|
max_displacement=2.8,
|
|
sigma=44.0,
|
|
seed=20260819,
|
|
),
|
|
}
|
|
|
|
balanced = smooth_warp(source, amplitude=0.75, sigma=56.0, seed=20260814)
|
|
balanced = affine_combo(balanced, rotation_degrees=0.2, zoom=0.004)
|
|
balanced = resize_squeeze(balanced, 0.94)
|
|
balanced = color_nudge(
|
|
balanced,
|
|
brightness=0.004,
|
|
contrast=0.006,
|
|
saturation=-0.005,
|
|
hue_degrees=0.15,
|
|
)
|
|
balanced = jpeg_chain(balanced, (94, 90))
|
|
candidates["fragment-balanced"] = balanced
|
|
|
|
strong = smooth_warp(source, amplitude=1.5, sigma=48.0, seed=20260815)
|
|
strong = affine_combo(strong, rotation_degrees=0.4, zoom=0.01)
|
|
strong = resize_squeeze(strong, 0.88)
|
|
strong = color_nudge(
|
|
strong,
|
|
brightness=0.008,
|
|
contrast=0.012,
|
|
saturation=-0.01,
|
|
hue_degrees=0.3,
|
|
)
|
|
strong = jpeg_chain(strong, (92, 88))
|
|
candidates["fragment-strong"] = strong
|
|
candidates["sham-strong-rms"] = norm_matched_noise(source, strong, seed=20260816)
|
|
|
|
bounded_balanced = bounded_smooth_warp(
|
|
source,
|
|
max_displacement=1.8,
|
|
sigma=56.0,
|
|
seed=20260820,
|
|
)
|
|
bounded_balanced = resize_squeeze(bounded_balanced, 0.98)
|
|
bounded_balanced = color_nudge(
|
|
bounded_balanced,
|
|
brightness=0.002,
|
|
contrast=0.003,
|
|
saturation=-0.003,
|
|
hue_degrees=0.1,
|
|
)
|
|
bounded_balanced = jpeg_chain(bounded_balanced, (96,))
|
|
candidates["bounded-fragment-balanced"] = bounded_balanced
|
|
|
|
bounded_strong = bounded_smooth_warp(
|
|
source,
|
|
max_displacement=2.8,
|
|
sigma=44.0,
|
|
seed=20260821,
|
|
)
|
|
bounded_strong = affine_combo(bounded_strong, rotation_degrees=0.2, zoom=0.004)
|
|
bounded_strong = resize_squeeze(bounded_strong, 0.94)
|
|
bounded_strong = color_nudge(
|
|
bounded_strong,
|
|
brightness=0.004,
|
|
contrast=0.006,
|
|
saturation=-0.005,
|
|
hue_degrees=0.15,
|
|
)
|
|
bounded_strong = jpeg_chain(bounded_strong, (94, 90))
|
|
candidates["bounded-fragment-strong"] = bounded_strong
|
|
candidates["sham-bounded-strong-rms"] = norm_matched_noise(source, bounded_strong, seed=20260822)
|
|
return candidates
|
|
|
|
|
|
@click.command()
|
|
@click.argument("codebook", type=click.Path(exists=True, dir_okay=False, path_type=Path))
|
|
@click.argument("source", type=click.Path(exists=True, dir_okay=False, path_type=Path))
|
|
@click.argument("output_dir", type=click.Path(file_okay=False, path_type=Path))
|
|
@click.option("--height", type=click.IntRange(min=64), required=True)
|
|
@click.option("--width", type=click.IntRange(min=64), required=True)
|
|
@click.option("--peak-count", type=click.IntRange(min=1), default=256, show_default=True)
|
|
def main(codebook: Path, source: Path, output_dir: Path, height: int, width: int, peak_count: int) -> None:
|
|
"""Write a frozen spatial-fragmentation batch for SOURCE."""
|
|
reference = load_rgb(source)
|
|
if reference.shape != (height, width, 3):
|
|
raise click.BadParameter("source geometry does not match --height and --width")
|
|
model = load_v3_model(codebook, height=height, width=width, peak_count=peak_count)
|
|
output_dir.mkdir(parents=True, exist_ok=True)
|
|
|
|
rows: list[dict[str, object]] = []
|
|
for name, pixels in build_candidates(reference).items():
|
|
path = output_dir / f"{name}.png"
|
|
Image.fromarray(pixels, mode="RGB").save(path)
|
|
rows.append(
|
|
{
|
|
**asdict(measure(reference, pixels, name=name, path=path)),
|
|
**asdict(score_image(path, model)),
|
|
}
|
|
)
|
|
report_path = output_dir / "report.json"
|
|
report_path.write_text(
|
|
json.dumps(
|
|
{
|
|
"source": str(source),
|
|
"codebook": str(codebook),
|
|
"height": height,
|
|
"width": width,
|
|
"peak_count": peak_count,
|
|
"variants": rows,
|
|
},
|
|
indent=2,
|
|
)
|
|
+ "\n",
|
|
encoding="utf-8",
|
|
)
|
|
log.info("Wrote %d frozen fragmentation candidates: %s", len(rows), report_path)
|
|
|
|
|
|
if __name__ == "__main__":
|
|
logging.basicConfig(level=logging.INFO, format="%(message)s")
|
|
main()
|