Watermark Detection on C4 (TPR at 1% FPR)
100TPR @ 1% FPR (No Attack)KGW
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| KGWBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 100 | 77.7 | 29 | 64.2 | |
| EXPBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 100 | 39.1 | 16.9 | 58.6 | |
| KGWBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 100 | 55.9 | 27.3 | 56.2 | |
| SynthIDBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 100 | 42.9 | 22.6 | 53 | |
| MorphMarkBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 99.8 | 48.3 | 20.4 | 49 | |
| UPVBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 99.7 | 67.1 | 44.5 | 71.5 | |
| MorphMarkBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 99.7 | 55.5 | 28 | 52.7 | |
| UPVBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 99.7 | 75 | 53.2 | 79.5 | |
| EXPBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 99.4 | 24.6 | 11.5 | 36.4 | |
| SynthIDBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 99.2 | 44.1 | 25.1 | 44.1 | |
| SemStampBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 96.4 | 40.4 | 27.9 | 61.7 | |
| PMarkBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 96.4 | 24.7 | 28.3 | 45 | |
| PMarkBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 96.2 | 40 | 48.9 | 67.6 | |
| SAMARKBackbone=Mistral-Small-3.1-24B-Base-2503, Quality Optimization=false2026.05 | 95.2 | 78.8 | 76.9 | 90 | |
| SemStampBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 95.1 | 28.6 | 17.2 | 54.7 | |
| SAMARKBackbone=Nemotron-Nano-9B-v2-Base, Quality Optimization=false2026.05 | 94.8 | 76.6 | 73.8 | 83.8 | |
| SAMARKBackbone=Mistral-Small-3.1-24B-Base-2503, Quality Optimization=true2026.05 | 94.5 | 78.6 | 76.8 | 84.2 | |
| SAMARKBackbone=Nemotron-Nano-9B-v2-Base, Quality Optimization=true2026.05 | 93.8 | 78.3 | 72.9 | 82.3 | |
| k-SemStampBackbone=Mistral-Small-3.1-24B-Base-25032026.05 | 92.5 | 22.5 | 15.5 | 44.5 | |
| k-SemStampBackbone=Nemotron-Nano-9B-v2-Base2026.05 | 90.5 | 15.6 | 14.6 | 32.1 |