Watermark Detection Robustness on Gemma-2 9B Pre-trained (test)
100TPR (Baseline)KGW
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| KGWBackbone=Gemma-2 9B2026.05 | 100 | 64 | 99 | 99 | 99 | 98 | 99 | 100 | 94 | 82 | |
| UnigramBackbone=Gemma-2 9B2026.05 | 100 | 62 | 98 | 97 | 98 | 97 | 99 | 99 | 93 | 80 | |
| AdaptiveBackbone=Gemma-2 9B2026.05 | 100 | 74 | 87 | 100 | 100 | 100 | 100 | 99 | 94 | 80 | |
| SLAM (k=10)Backbone=Gemma-2 9B, PCA-bidirectional=true2026.05 | 100 | 10 | 100 | 100 | 100 | 100 | 100 | 100 | 87 | 55 | |
| EWDBackbone=Gemma-2 9B2026.05 | 99 | 46 | 5 | 6 | 95 | 95 | 80 | 6 | 48 | 26 | |
| SynthIDBackbone=Gemma-2 9B2026.05 | 99 | 14 | 68 | 81 | 68 | 40 | 79 | 96 | 64 | 41 | |
| SAEMarkBackbone=Gemma-2 9B2026.05 | 13 | 2 | 10 | 10 | 11 | 8 | 10 | 3 | 8 | 6 |