Instructions to use wiltodelta/raiw-source-classify with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Grok
How to use wiltodelta/raiw-source-classify with Grok:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
# No code snippets available yet for this library.
# To use this model, check the repository files and the library's documentation.
# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js
RAIW multi-provider source-pipeline classifier (multi-provider-source-v6)
This repository contains the compact (15.52 MB), CPU-only, pickle-free (allow_pickle=False) NumPy weights for the abstaining remove-ai-watermarks pixel source-pipeline classifier across 10 AI provider families (openai, google, bytedance, flux, stable_diffusion, meta, midjourney, ideogram, firefly, xai) plus unknown, with Stage-2 model/export version attribution (version_subfamily).
This model is not a SynthID detector and does not decode or verify any cryptographic or invisible watermark payload (watermark_truth="unknown"). Its labels describe complete generation and export pixel pipelines, so renderer, geometry, encoding, post-processing, and watermark state may be confounded. unknown does not mean that SynthID is absent, and a provider label does not prove that SynthID is present.
Quickstart (pure NumPy, CPU-only, no PyTorch required)
pip install "remove-ai-watermarks[source-classify]"
import remove_ai_watermarks as raiw
res = raiw.classify_source("image.jpg")
print(res.label, res.version_subfamily, round(res.confidence, 4))
# e.g. 'openai' 'openai:gpt_image_1_5' 0.9942 (or 'unknown' None 0.9815 on real photos)
Command line (installed CLI or zero-setup uv run with the bundled infer.py and open-detector benchmark.py):
remove-ai-watermarks classify-source image.jpg --json
uv run https://huggingface.co/wiltodelta/raiw-source-classify/resolve/main/infer.py image.jpg --json
uv run https://huggingface.co/wiltodelta/raiw-source-classify/resolve/main/infer.py --inspect-weights
uv run https://huggingface.co/wiltodelta/raiw-source-classify/resolve/main/benchmark.py
uv run https://huggingface.co/wiltodelta/raiw-source-classify/resolve/main/benchmark.py --tier frontier
Try it in your browser on the Remove AI Watermarks Hugging Face Space or at raiw.cc. Set RAIW_SOURCE_CLASSIFY_WEIGHTS to multi-provider-source-v6.npz or its parent directory for air-gapped deployments.
Model architecture
- Input (
512-d,extract_512d_v4_features):112-dadaptive overlapping native-tile truncated SRM micro-residuals across flat and textured regions.128-dphase-resolved modulo-8 / modulo-16 sublattice energy, cropped-grid secondary-phase detection, interior VAE modulation, and8x8block-DCT quantization comb statistics.144-dMoisan periodic-plus-smooth (p + s) spectral decomposition, radial decay profile, and continuous scale-invariant period-comb scanner.96-dpatch-averaged cross-channel spectral phase coherence, Bayer/Quad-Bayer CFA periodicity, heteroscedastic shot-noise slope, and radial chromatic-aberration alignment.32-dexplicit codec, aspect-ratio, scale, and social-recompression regime vector (x[480:512]).
- Stage 1 (
154unit channels +962D multiplicative interaction gates across10canonical providers):- Two-tower ensemble executed in pure NumPy:
5multi-seed Regime-FiLMLayerNorm+SiLUresidual MLP trunks (12provider/unknown/supported-AI logits +45subfamily logits) paired with65packedHistGradientBoostingspecialist forests (global provider, subfamily, codec-regime, hard-domain veto, and21pairwise cross-AI disambiguator heads), trained with strict parent-disjoint geometry positives (crop96_jpeg+resize_lanczos_jpeg). - Decoupled Stage-1.5 router over the
558-dgate-expanded feature vector (multi-provider-source-v5runtime schema): an11-channel regime-aware acceptance detector (per-provider acceptance channels plus a global supported-AI channel standardized against a regime-null baseline) paired with a prior-calibratedLayerNorm+SiLUconditional attribution MLP with linear skip projection (attr_skip_w), making provider attribution invariant tounknownthreshold tightening.
- Two-tower ensemble executed in pure NumPy:
- Stage 2 (
9stacked blended version heads,666-d):- Vectorized
HistGradientBoostingtree ensembles blended with standardized linear heads over the512-ddescriptor concatenated with the154Stage-1 unit scores (666-d) to predict the canonical model/export subfamily (version_subfamily).
- Vectorized
- Artifact:
multi-provider-source-v6.npz(allow_pickle=False,15.52 MB) - SHA-256:
87868eea08b8b811999f675186b82b067c4de655981cb7f25114aac00b1dd284
The artifact contains only learned parameters, normalization constants, tree arrays, labels, and calibrated thresholds. It does not contain training images, paths, image hashes, embeddings, or a training catalog.
Evaluation (145,110 deduplicated feature views; 10,585 locked test)
The operating point was selected strictly on disjoint calibration partitions (8,363 primary calibration views, 3,011 social-recompressed real negatives, and 2,972 crop/resize development views across 16 fine-grained real-image varieties and group-locked parent_sha256 families). On the 10,585-image locked test split (4,538 multi-variety unknown negatives + 6,047 AI provider images across native, resized, and social-recompressed views):
- Unified 10-provider router:
99.93%unknownspecificity (3 / 4,538false positives,0.07%testunknownFPR;0.00%photographic FPR and0.13%non-photographic structured FPR),83.28%exact provider recall (84.14%on clean-provenance AI;86.67%any-AI recall;92.45%native,92.95%resized, and77.06%recompressed exact recall),99.94%any-AI precision when firing (96.09%exact-provider accuracy among classified AI;95.93%overall Stage-2 version accuracy given exact provider), and0.9977binary ROC-AUC /0.9985binary PR-AUC (0.9977mean standalone provider ROC-AUC).
| Provider | Test count | Standalone ROC AUC | Router recall | Router precision | Stage-2 version accuracy |
|---|---|---|---|---|---|
openai |
1,478 | 0.9997 | 92.1% | 96.1% | 95.6% |
google |
1,382 | 0.9996 | 86.4% | 97.5% | 97.0% |
bytedance |
389 | 0.9863 | 72.0% | 98.9% | 96.8% |
flux |
1,357 | 0.9993 | 80.8% | 95.2% | 95.0% |
stable_diffusion |
955 | 0.9987 | 77.2% | 98.1% | 98.0% |
meta |
94 | 0.9995 | 86.2% | 98.8% | - (meta:imagine) |
midjourney |
123 | 1.0000 | 82.1% | 87.8% | 98.0% |
ideogram |
118 | 0.9999 | 84.7% | 78.7% | 77.0% |
firefly |
103 | 0.9948 | 61.2% | 91.3% | 100.0% |
xai |
48 | 0.9990 | 45.8% | 91.7% | 77.3% |
Held-out real-image specificity by variety (4,538 test negatives across 16 real classes + foreign AI)
| Real-image variety | Test count | False positives | False-positive rate | Specificity |
|---|---|---|---|---|
photo |
2,183 | 0 | 0.00% | 100.00% |
photo_retouched |
339 | 2 | 0.59% | 99.41% |
classical_inpaint |
17 | 0 | 0.00% | 100.00% |
digital_art |
440 | 1 | 0.23% | 99.77% |
game_art |
174 | 0 | 0.00% | 100.00% |
vector |
135 | 0 | 0.00% | 100.00% |
interface |
180 | 0 | 0.00% | 100.00% |
diagram |
98 | 0 | 0.00% | 100.00% |
chart_data_viz |
159 | 0 | 0.00% | 100.00% |
technical_architecture |
84 | 0 | 0.00% | 100.00% |
procedural_graphic |
13 | 0 | 0.00% | 100.00% |
document |
165 | 0 | 0.00% | 100.00% |
gov_scientific_doc |
32 | 0 | 0.00% | 100.00% |
receipt_invoice |
181 | 0 | 0.00% | 100.00% |
print_publishing |
229 | 0 | 0.00% | 100.00% |
stress_recompressed |
103 | 0 | 0.00% | 100.00% |
foreign_ai |
6 | 0 | 0.00% | 100.00% |
External blind multi-variety real-image verification (selective-v8, 2,267 untouched images)
Evaluated on the external selective-v8 blind real-image cohorts (2,267 images; 2,265 strictly parent-disjoint from locked_test): 1 / 2,267 false positives (0.04% overall FPR, 99.96% specificity), plus 0 / 60 false positives (0.00% FPR) on external phone thermal receipts.
Blind selective-v8 cell |
Evaluated | False positives | False-positive rate | Specificity |
|---|---|---|---|---|
photo |
450 | 0 | 0.00% | 100.00% |
vector |
332 | 0 | 0.00% | 100.00% |
game_art |
230 | 0 | 0.00% | 100.00% |
interface |
342 | 0 | 0.00% | 100.00% |
diagram |
305 | 0 | 0.00% | 100.00% |
document |
308 | 0 | 0.00% | 100.00% |
stress_recompressed |
300 | 1 | 0.33% | 99.67% |
Intended use
Install remove-ai-watermarks[source-classify] and call the explicit Python API classify_source(path) or CLI command remove-ai-watermarks classify-source <IMAGE>. identify does not run this model. Set RAIW_SOURCE_CLASSIFY_WEIGHTS to the .npz file or its parent directory for offline deployments.
- Downloads last month
- 60