Watermark Detection Robustness on C4
96.97TP@FP=1%PMARK (Online)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PMARK (Online)Backbone=Mistral-7B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 96.97 | 100 | 99.91 | |
| PMARK (Online)Backbone=OPT-1.3B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 88.46 | 96.15 | 97.63 | |
| PMARK (Offline)Backbone=OPT-1.3B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 75 | 95.83 | 98.26 | |
| UPVBackbone=OPT-1.3B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 59.2 | 78.98 | 95.68 | |
| PMARK (Offline)Backbone=Mistral-7B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 41.67 | 63.95 | 91.64 | |
| KGWBackbone=Mistral-7B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 37.82 | 65.17 | 91.62 | |
| KGWBackbone=OPT-1.3B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 34.2 | 68.84 | 90.51 | |
| UPVBackbone=Mistral-7B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 10.62 | 46.42 | 89.03 | |
| SynthIDBackbone=Mistral-7B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 7.11 | 12.82 | 66.33 | |
| SynthIDBackbone=OPT-1.3B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 1.83 | 25.98 | 69.14 | |
| KSEMSTAMPBackbone=OPT-1.3B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 0 | 0.81 | 53.77 | |
| KSEMSTAMPBackbone=Mistral-7B, Attack Type=paragraph-level paraphrasing (GPT-3.5-turbo)2025.09 | 0 | 2.26 | 50.79 |