Watermark Detection on C4 (Specific FPR Points)
100TPR @ 1% FPRTBW
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| TBWModel=Gemma-7B, Attacks=No Attack2024.04 | 100 | 100 | |
| KGWModel=Gemma-7B, Attacks=No Attack2024.04 | 100 | 100 | |
| DiPModel=Gemma-7B, Attacks=No Attack2024.04 | 100 | 100 | |
| SynthIDModel=Gemma-7B, Attacks=No Attack2024.04 | 100 | 100 | |
| UnigramModel=Gemma-7B, Attacks=No Attack2024.04 | 99.8 | 100 | |
| KGWModel=OPT-6.7B, Attacks=No Attack2024.04 | 99.6 | 100 | |
| UnigramModel=OPT-6.7B, Attacks=No Attack2024.04 | 99.6 | 99.6 | |
| TBWModel=OPT-6.7B, Attacks=No Attack2024.04 | 99.4 | 100 | |
| DiPModel=OPT-6.7B, Attacks=No Attack2024.04 | 99.2 | 99.6 | |
| SynthIDModel=OPT-6.7B, Attacks=No Attack2024.04 | 99.2 | 99.6 | |
| SIRModel=OPT-6.7B, Attacks=No Attack2024.04 | 96.4 | 98.6 | |
| TBWModel=OPT-6.7B, Attacks=Pegasus2024.04 | 91 | 98 | |
| UnigramModel=OPT-6.7B, Attacks=Pegasus2024.04 | 90 | 98.6 | |
| SIRModel=Gemma-7B, Attacks=No Attack2024.04 | 89 | 99.8 | |
| TBWModel=Gemma-7B, Attacks=Pegasus2024.04 | 84.2 | 96 | |
| SIRModel=OPT-6.7B, Attacks=Pegasus2024.04 | 72.6 | 93 | |
| UnigramModel=Gemma-7B, Attacks=Pegasus2024.04 | 59.8 | 98 | |
| KGWModel=OPT-6.7B, Attacks=Pegasus2024.04 | 57.8 | 94.8 | |
| TBWModel=OPT-6.7B, Attacks=DIPPER2024.04 | 53.6 | 86.6 | |
| UnigramModel=OPT-6.7B, Attacks=DIPPER2024.04 | 51.6 | 87.2 | |
| SynthIDModel=Gemma-7B, Attacks=Pegasus2024.04 | 48.4 | 75 | |
| SIRModel=Gemma-7B, Attacks=Pegasus2024.04 | 47.6 | 89.6 | |
| SynthIDModel=OPT-6.7B, Attacks=Pegasus2024.04 | 44.6 | 76.8 | |
| DiPModel=Gemma-7B, Attacks=Pegasus2024.04 | 28.2 | 61.4 | |
| SIRModel=OPT-6.7B, Attacks=DIPPER2024.04 | 24.8 | 70.2 | |
| KGWModel=Gemma-7B, Attacks=Pegasus2024.04 | 24.6 | 97.4 | |
| DiPModel=OPT-6.7B, Attacks=Pegasus2024.04 | 22.8 | 55.2 | |
| TBWModel=Gemma-7B, Attacks=DIPPER2024.04 | 19.6 | 61.2 | |
| SIRModel=Gemma-7B, Attacks=DIPPER2024.04 | 19 | 52.4 | |
| KGWModel=OPT-6.7B, Attacks=DIPPER2024.04 | 12.4 | 53.4 | |
| SynthIDModel=OPT-6.7B, Attacks=DIPPER2024.04 | 5.8 | 25.8 | |
| KGWModel=Gemma-7B, Attacks=DIPPER2024.04 | 5.2 | 56.8 | |
| UnigramModel=Gemma-7B, Attacks=DIPPER2024.04 | 3.4 | 76.6 | |
| DiPModel=OPT-6.7B, Attacks=DIPPER2024.04 | 2.8 | 17 | |
| SynthIDModel=Gemma-7B, Attacks=DIPPER2024.04 | 2.4 | 28.8 | |
| DiPModel=Gemma-7B, Attacks=DIPPER2024.04 | 2.2 | 16.4 |