Watermark Robustness (B.Acc Perturbations) on C4
94.9B.Acc (REP 0.05)HeRo¹
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HeRo¹parameter=(3), base_model=Llama2-7B, payload_size=24-bit, tokens=2002026.07 | 94.9 | 89.8 | 75.2 | 95.2 | 90.6 | 78.2 | 95.8 | 92 | 79.8 | 78 | 80 | 93.1 | 77.8 | |
| HeRo²parameter=(2, 2), base_model=Llama2-7B, payload_size=24-bit, tokens=2002026.07 | 87.1 | 80 | 67.7 | 86.8 | 80.9 | 70.7 | 87.9 | 82.5 | 71 | 70.7 | 72.3 | 84.8 | 70.1 | |
| BiMarkparameter=(20), base_model=Llama2-7B, payload_size=24-bit, tokens=2002026.07 | 83.3 | 76.8 | 65.8 | 83.8 | 77.8 | 67.7 | 84.5 | 79.3 | 69.2 | 68.7 | 70.3 | 81.7 | 69.1 | |
| MPACparameter=(2, 2.0), base_model=Llama2-7B, payload_size=24-bit, tokens=2002026.07 | 80.9 | 73.9 | 62.2 | 81.4 | 75.4 | 64.8 | 82.7 | 76.6 | 66.3 | 65 | 66.9 | 79.4 | 64.6 | |
| StealthInkparameter=(2), base_model=Llama2-7B, payload_size=24-bit, tokens=2002026.07 | 67.7 | 62 | 55.2 | 68.4 | 63 | 55.9 | 69 | 64.3 | 57.5 | 56.9 | 58.2 | 66.5 | 57.3 |