Sentence-Level Watermarking on C4
100AUROCKGW
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| KGWBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 100 | 100 | 100 | |
| SynthIDBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 100 | 100 | 100 | |
| AliMarkBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 99.9 | 99.2 | 99.8 | |
| SIRBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 99.8 | 93.4 | 96.8 | |
| SemStampBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 99.6 | 96 | 96.8 | |
| k-SemStampBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 99.3 | 8.7 | 81.7 | |
| AliMarkBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 99.2 | 75.7 | 88.2 | |
| SIRBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 98.6 | 59.8 | 75.2 | |
| PMarkBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 98.4 | 93 | 93.2 | |
| AliMarkBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 98.4 | 65.7 | 81 | |
| SimMarkBackbone=gemma-3-1B-pt, Attack Type=No Attack2026.05 | 98.3 | 14.6 | 75.6 | |
| SimMarkBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 97.2 | 7.6 | 57.4 | |
| PMarkBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 97.1 | 81.2 | 82 | |
| SimMarkBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 97 | 6.6 | 54.8 | |
| SemStampBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 96.1 | 53.9 | 59.6 | |
| SynthIDBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 95.9 | 45 | 56.4 | |
| SIRBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 95.8 | 52.6 | 68.4 | |
| PMarkBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 94.7 | 69.6 | 71.4 | |
| SemStampBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 93.7 | 48.4 | 53.8 | |
| k-SemStampBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 93.5 | 1 | 29.3 | |
| AliMarkBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 91.9 | 34 | 50.9 | |
| SynthIDBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 91.7 | 31.6 | 43.6 | |
| AliMarkBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 91.6 | 33.3 | 49.9 | |
| k-SemStampBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 91 | 1.4 | 27.6 | |
| SIRBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 89.3 | 16.8 | 27.8 | |
| SimMarkBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 89.1 | 1.6 | 20.6 | |
| SIRBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 86.4 | 10.6 | 20.2 | |
| PMarkBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 83.3 | 22.8 | 24 | |
| PMarkBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 81.4 | 20.4 | 23 | |
| KGWBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 79.9 | 5 | 7.4 | |
| SemStampBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 78.9 | 13.7 | 18 | |
| SimMarkBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 77.7 | 0.2 | 6.8 | |
| KGWBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 77.1 | 2.8 | 5.2 | |
| k-SemStampBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 77.1 | 0.8 | 6.8 | |
| KGWBackbone=gemma-3-1B-pt, Attack Type=Pegasus2026.05 | 76.4 | 1.6 | 2.2 | |
| SemStampBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 75.7 | 10.7 | 15.3 | |
| k-SemStampBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 75.1 | 0 | 3.2 | |
| SynthIDBackbone=gemma-3-1B-pt, Attack Type=DIPPER2026.05 | 73.4 | 1.4 | 5.4 | |
| KGWBackbone=gemma-3-1B-pt, Attack Type=Parrot2026.05 | 72 | 1 | 2 | |
| SynthIDBackbone=gemma-3-1B-pt, Attack Type=GPT-3.52026.05 | 68.4 | 3.2 | 7 |