Watermark Detection on C4 subset
100AccuracyMC2MARK
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MC2MARKmessage length (n)=16, Backbone=Llama-3.2-3B-Instruct2026.02 | 100 | — | — | — | — | — | — | |
| MC2MARKmessage length (n)=32, Backbone=Llama-3.2-3B-Instruct2026.02 | 100 | — | — | — | — | — | — | |
| MC2MARKmessage length (n)=64, Backbone=Llama-3.2-3B-Instruct2026.02 | 99.97 | — | — | — | — | — | — | |
| MC2MARKmessage length (n)=128, Backbone=Llama-3.2-3B-Instruct2026.02 | 99.94 | — | — | — | — | — | — | |
| MC2MARKmessage length (n)=256, Backbone=Llama-3.2-3B-Instruct2026.02 | 99.61 | — | — | — | — | — | — | |
| BiMarkmessage length (n)=16, Backbone=Llama-3.2-3B-Instruct2026.02 | 97.75 | — | — | — | — | — | — | |
| MC2MARKmessage length (n)=512, Backbone=Llama-3.2-3B-Instruct2026.02 | 95.77 | — | — | — | — | — | — | |
| BiMarkmessage length (n)=32, Backbone=Llama-3.2-3B-Instruct2026.02 | 94.34 | — | — | — | — | — | — | |
| MPAC(1.5)message length (n)=16, Backbone=Llama-3.2-3B-Instruct2026.02 | 89.69 | — | — | — | — | — | — | |
| BiMarkmessage length (n)=64, Backbone=Llama-3.2-3B-Instruct2026.02 | 87.14 | — | — | — | — | — | — | |
| MPAC(1.5)message length (n)=32, Backbone=Llama-3.2-3B-Instruct2026.02 | 85.84 | — | — | — | — | — | — | |
| MPAC(1.0)message length (n)=16, Backbone=Llama-3.2-3B-Instruct2026.02 | 80.75 | — | — | — | — | — | — | |
| MPAC(1.5)message length (n)=64, Backbone=Llama-3.2-3B-Instruct2026.02 | 77.31 | — | — | — | — | — | — | |
| MPAC(1.0)message length (n)=32, Backbone=Llama-3.2-3B-Instruct2026.02 | 74.44 | — | — | — | — | — | — | |
| BiMarkmessage length (n)=128, Backbone=Llama-3.2-3B-Instruct2026.02 | 74.17 | — | — | — | — | — | — | |
| MPAC(1.5)message length (n)=128, Backbone=Llama-3.2-3B-Instruct2026.02 | 70.56 | — | — | — | — | — | — | |
| MPAC(1.0)message length (n)=64, Backbone=Llama-3.2-3B-Instruct2026.02 | 70 | — | — | — | — | — | — | |
| MPAC(1.5)message length (n)=256, Backbone=Llama-3.2-3B-Instruct2026.02 | 65.82 | — | — | — | — | — | — | |
| MPAC(1.0)message length (n)=128, Backbone=Llama-3.2-3B-Instruct2026.02 | 62.57 | — | — | — | — | — | — | |
| MPAC(1.5)message length (n)=512, Backbone=Llama-3.2-3B-Instruct2026.02 | 60.24 | — | — | — | — | — | — | |
| MPAC(1.0)message length (n)=256, Backbone=Llama-3.2-3B-Instruct2026.02 | 58.27 | — | — | — | — | — | — | |
| MPAC(1.0)message length (n)=512, Backbone=Llama-3.2-3B-Instruct2026.02 | 56.13 | — | — | — | — | — | — | |
| BiMarkmessage length (n)=256, Backbone=Llama-3.2-3B-Instruct2026.02 | 54.73 | — | — | — | — | — | — | |
| BiMarkmessage length (n)=512, Backbone=Llama-3.2-3B-Instruct2026.02 | 34.88 | — | — | — | — | — | — | |
| DiPmarkAttack=DIPPER, alpha=0.42025.02 | — | 1.7 | 0.3 | 0 | 0 | 0.9634 | 0.3314 | |
| DiPmarkAttack=DIPPER, alpha=0.32025.02 | — | 1.3 | 0.6 | 0 | 0 | 0.978 | 0.3191 | |
| DiPmarkalpha=0.42025.02 | — | 60.4 | 46.8 | 30.8 | 19.8 | 0.0138 | 0.8352 | |
| DiPmarkalpha=0.32025.02 | — | 52.8 | 35.5 | 19.8 | 9.8 | 0.0983 | 0.7859 | |
| EXP-editAttack=DIPPER2025.02 | — | 16.6 | 9.2 | 3.5 | — | 0.3735 | 0.5976 | |
| EXP-edit2025.02 | — | 73.9 | 66.8 | 60.4 | — | 0.0002 | 0.8841 | |
| gamma-reweight2025.02 | — | 64.5 | 50.8 | 32.2 | 18 | 0.0092 | 0.852 | |
| ITS-editAttack=DIPPER2025.02 | — | 5.1 | 1.3 | 0.1 | — | 0.5206 | 0.4898 | |
| ITS-edit2025.02 | — | 6.2 | 2.3 | 1 | — | 0.471 | 0.5136 | |
| MCmarkAttack=DIPPER, l=202025.02 | — | 24.1 | 11 | 3.6 | 1 | 0.1976 | 0.695 | |
| MCmarkl=202025.02 | — | 94.6 | 91.6 | 86.8 | 81.2 | 0 | 0.9796 | |
| STA-1Attack=DIPPER2025.02 | — | 11.6 | 3.4 | 0.6 | 0.1 | 0.3652 | 0.5917 | |
| STA-12025.02 | — | 66.5 | 45.1 | 24 | 11.1 | 0.0151 | 0.8926 | |
| y-reweightAttack=DIPPER2025.02 | — | 1.8 | 0.4 | 0 | 0 | 0.9745 | 0.3124 |