Text Watermarking on C4
4.21PPLBiMark
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BiMarkMethod Parameters=(20), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.21 | — | — | — | — | — | — | — | — | — | — | — | — | 96.1 | |
| BiMarkMethod Parameters=(10), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.25 | — | — | — | — | — | — | — | — | — | — | — | — | 91.4 | |
| BiMarkMethod Parameters=(5), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.26 | — | — | — | — | — | — | — | — | — | — | — | — | 73.1 | |
| BiMarkMethod Parameters=(20), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.26 | — | — | — | — | — | — | — | — | — | — | — | — | 81.2 | |
| StealthInkMethod Parameters=(2), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.27 | — | — | — | — | — | — | — | — | — | — | — | — | 84.3 | |
| HeRo2Method Parameters=(2,1), S.D.=true, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.27 | — | — | — | — | — | — | — | — | — | — | — | — | 85.6 | |
| BiMarkMethod Parameters=(5), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.28 | — | — | — | — | — | — | — | — | — | — | — | — | 76.7 | |
| HeRo1Method Parameters=(2), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.28 | — | — | — | — | — | — | — | — | — | — | — | — | 96.6 | |
| HeRo2Method Parameters=(2,1), S.D.=true, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.28 | — | — | — | — | — | — | — | — | — | — | — | — | 90.4 | |
| HeRo2Method Parameters=(2,2), S.D.=true, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.28 | — | — | — | — | — | — | — | — | — | — | — | — | 83.3 | |
| BiMarkMethod Parameters=(20), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.29 | — | — | — | — | — | — | — | — | — | — | — | — | 85.2 | |
| HeRo1Method Parameters=(3), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.29 | — | — | — | — | — | — | — | — | — | — | — | — | 95.3 | |
| BiMarkMethod Parameters=(10), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.3 | — | — | — | — | — | — | — | — | — | — | — | — | 78.8 | |
| HeRo2Method Parameters=(2,1), S.D.=true, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.3 | — | — | — | — | — | — | — | — | — | — | — | — | 97 | |
| HeRo2Method Parameters=(2,2), S.D.=true, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.3 | — | — | — | — | — | — | — | — | — | — | — | — | 97.5 | |
| HeRo2Method Parameters=(2,2), S.D.=true, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.3 | — | — | — | — | — | — | — | — | — | — | — | — | 87.3 | |
| w/o WatermarkPayload Size=12 Bits, S.D.=false, Base Model=Llama2-7B, Generation Length=200 tokens2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o WatermarkPayload Size=24 Bits, S.D.=false, Base Model=Llama2-7B, Generation Length=200 tokens2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o WatermarkPayload Size=36 Bits, S.D.=false, Base Model=Llama2-7B, Generation Length=200 tokens2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o WatermarkPayload Size=48 Bits, S.D.=false, Base Model=Llama2-7B, Generation Length=200 tokens2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| StealthInkMethod Parameters=(2), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 74.8 | |
| BiMarkMethod Parameters=(5), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 86.6 | |
| BiMarkMethod Parameters=(10), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 74.6 | |
| HeRo1Method Parameters=(2), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 93.3 | |
| HeRo1Method Parameters=(3), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 99.7 | |
| HeRo2Method Parameters=(1,1), S.D.=true, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 95 | |
| HeRo2Method Parameters=(1,1), S.D.=true, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.31 | — | — | — | — | — | — | — | — | — | — | — | — | 88 | |
| StealthInkMethod Parameters=(1), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 80.5 | |
| StealthInkMethod Parameters=(1), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 76.9 | |
| BiMarkMethod Parameters=(10), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 82.7 | |
| BiMarkMethod Parameters=(20), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 89.4 | |
| HeRo1Method Parameters=(2), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 99.3 | |
| HeRo1Method Parameters=(3), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 91.9 | |
| HeRo2Method Parameters=(1,1), S.D.=true, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 83.1 | |
| HeRo2Method Parameters=(2,1), S.D.=true, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.32 | — | — | — | — | — | — | — | — | — | — | — | — | 82.3 | |
| StealthInkMethod Parameters=(1), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.33 | — | — | — | — | — | — | — | — | — | — | — | — | 84.5 | |
| StealthInkMethod Parameters=(2), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.33 | — | — | — | — | — | — | — | — | — | — | — | — | 73.1 | |
| BiMarkMethod Parameters=(5), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.33 | — | — | — | — | — | — | — | — | — | — | — | — | 70.2 | |
| HeRo1Method Parameters=(2), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.33 | — | — | — | — | — | — | — | — | — | — | — | — | 90.1 | |
| HeRo1Method Parameters=(3), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.33 | — | — | — | — | — | — | — | — | — | — | — | — | 98.1 | |
| HeRo2Method Parameters=(1,1), S.D.=true, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.33 | — | — | — | — | — | — | — | — | — | — | — | — | 79.8 | |
| StealthInkMethod Parameters=(1), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.36 | — | — | — | — | — | — | — | — | — | — | — | — | 93.4 | |
| HeRo2Method Parameters=(2,2), S.D.=true, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.36 | — | — | — | — | — | — | — | — | — | — | — | — | 92.5 | |
| StealthInkMethod Parameters=(2), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.37 | — | — | — | — | — | — | — | — | — | — | — | — | 68.7 | |
| MPACMethod Parameters=(1, 2.0), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.64 | — | — | — | — | — | — | — | — | — | — | — | — | 80 | |
| MPACMethod Parameters=(1, 2.0), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.69 | — | — | — | — | — | — | — | — | — | — | — | — | 95.4 | |
| MPACMethod Parameters=(1, 2.0), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.69 | — | — | — | — | — | — | — | — | — | — | — | — | 84 | |
| MPACMethod Parameters=(1, 2.0), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.71 | — | — | — | — | — | — | — | — | — | — | — | — | 87.6 | |
| MPACMethod Parameters=(2, 2.0), S.D.=false, Payload Size=36 Bits, Base Model=Llama2-7B2026.07 | 4.75 | — | — | — | — | — | — | — | — | — | — | — | — | 83.5 | |
| MPACMethod Parameters=(2, 2.0), S.D.=false, Payload Size=48 Bits, Base Model=Llama2-7B2026.07 | 4.75 | — | — | — | — | — | — | — | — | — | — | — | — | 80.2 | |
| MPACMethod Parameters=(2, 2.0), S.D.=false, Payload Size=24 Bits, Base Model=Llama2-7B2026.07 | 4.76 | — | — | — | — | — | — | — | — | — | — | — | — | 88.2 | |
| MPACMethod Parameters=(2, 2.0), S.D.=false, Payload Size=12 Bits, Base Model=Llama2-7B2026.07 | 4.78 | — | — | — | — | — | — | — | — | — | — | — | — | 95.9 | |
| UnWMBackbone=OPT-6.7B, Generation Time (s)=4.2656, Memory Usage (B)=02025.05 | 9.012 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MorphMark_expBackbone=OPT-6.7B, Generation Time (s)=4.5198, Detection Time (ms)=35.97, Memory Usage (B)=02025.05 | 9.6618 | 1 | 0.91 | 0.9975 | 0.9763 | — | — | — | — | — | — | — | — | — | |
| UnWMBackbone=OPT-2.7B, Generation Time (s)=3.1573, Memory Usage (B)=02025.05 | 9.6683 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MorphMark_linearBackbone=OPT-6.7B, Generation Time (s)=4.4456, Detection Time (ms)=35.15, Memory Usage (B)=02025.05 | 9.7391 | 0.9975 | 0.925 | 0.995 | 0.9637 | — | — | — | — | — | — | — | — | — | |
| MorphMark_logBackbone=OPT-6.7B, Generation Time (s)=4.4537, Detection Time (ms)=35.45, Memory Usage (B)=02025.05 | 9.8585 | 0.995 | 0.8975 | 0.995 | 0.9602 | — | — | — | — | — | — | — | — | — | |
| KGWBackbone=OPT-6.7B, Generation Time (s)=4.3163, Detection Time (ms)=32.3, Memory Usage (B)=02025.05 | 9.9602 | 0.995 | 0.815 | 0.9975 | 0.9058 | — | — | — | — | — | — | — | — | — | |
| EWDBackbone=OPT-6.7B, Generation Time (s)=4.3393, Detection Time (ms)=61.74, Memory Usage (B)=6.72025.05 | 9.9925 | 1 | 0.835 | 0.9975 | 0.9523 | — | — | — | — | — | — | — | — | — | |
| SWEETBackbone=OPT-6.7B, Generation Time (s)=4.3931, Detection Time (ms)=62.2, Memory Usage (B)=6.72025.05 | 10.0633 | 0.9925 | 0.7925 | 0.9975 | 0.9539 | — | — | — | — | — | — | — | — | — | |
| DiPmarkBackbone=OPT-6.7B, Generation Time (s)=4.4363, Detection Time (ms)=75.13, Memory Usage (B)=02025.05 | 10.2747 | 0.9975 | 0.6625 | 0.9925 | 0.9073 | — | — | — | — | — | — | — | — | — | |
| UWBackbone=OPT-6.7B, Generation Time (s)=4.4407, Detection Time (ms)=75.04, Memory Usage (B)=02025.05 | 10.3701 | 0.995 | 0.7025 | 0.9899 | 0.8971 | — | — | — | — | — | — | — | — | — | |
| MorphMark_linearBackbone=OPT-2.7B, Generation Time (s)=3.4149, Detection Time (ms)=34, Memory Usage (B)=02025.05 | 10.3852 | 1 | 0.93 | 0.9988 | 0.9701 | — | — | — | — | — | — | — | — | — | |
| UnWMBackbone=OPT-1.3B, Generation Time (s)=2.4374, Memory Usage (B)=02025.05 | 10.4815 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MorphMark_expBackbone=OPT-2.7B, Generation Time (s)=3.5074, Detection Time (ms)=34.64, Memory Usage (B)=02025.05 | 10.5144 | 1 | 0.9625 | 0.9987 | 0.9686 | — | — | — | — | — | — | — | — | — | |
| EWDBackbone=OPT-2.7B, Generation Time (s)=3.218, Detection Time (ms)=49.56, Memory Usage (B)=2.72025.05 | 10.6303 | 1 | 0.85 | 0.9988 | 0.9588 | — | — | — | — | — | — | — | — | — | |
| MorphMark_logBackbone=OPT-2.7B, Generation Time (s)=3.6792, Detection Time (ms)=34.63, Memory Usage (B)=02025.05 | 10.6717 | 0.9975 | 0.925 | 0.9988 | 0.9628 | — | — | — | — | — | — | — | — | — | |
| SWEETBackbone=OPT-2.7B, Generation Time (s)=3.2605, Detection Time (ms)=49.46, Memory Usage (B)=2.72025.05 | 10.8377 | 0.9975 | 0.835 | 0.9962 | 0.9566 | — | — | — | — | — | — | — | — | — | |
| UWBackbone=OPT-2.7B, Generation Time (s)=3.3178, Detection Time (ms)=72.86, Memory Usage (B)=02025.05 | 10.8593 | 0.995 | 0.69 | 0.9962 | 0.9202 | — | — | — | — | — | — | — | — | — | |
| KGWBackbone=OPT-2.7B, Generation Time (s)=3.2353, Detection Time (ms)=33.01, Memory Usage (B)=02025.05 | 10.9324 | 0.995 | 0.8275 | 0.995 | 0.9098 | — | — | — | — | — | — | — | — | — | |
| DiPmarkBackbone=OPT-2.7B, Generation Time (s)=3.3126, Detection Time (ms)=72.83, Memory Usage (B)=02025.05 | 11.0013 | 0.99 | 0.7125 | 0.9913 | 0.9058 | — | — | — | — | — | — | — | — | — | |
| MorphMark_linearBackbone=OPT-1.3B, Generation Time (s)=2.6537, Detection Time (ms)=33.99, Memory Usage (B)=02025.05 | 11.2386 | 1 | 0.9275 | 0.9962 | 0.9727 | — | — | — | — | — | — | — | — | — | |
| MorphMark_logBackbone=OPT-1.3B, Generation Time (s)=2.6889, Detection Time (ms)=34.45, Memory Usage (B)=02025.05 | 11.3379 | 1 | 0.9375 | 1 | 0.966 | — | — | — | — | — | — | — | — | — | |
| MorphMark_expBackbone=OPT-1.3B, Generation Time (s)=2.6768, Detection Time (ms)=34.17, Memory Usage (B)=02025.05 | 11.3569 | 1 | 0.96 | 0.9975 | 0.9778 | — | — | — | — | — | — | — | — | — | |
| EWDBackbone=OPT-1.3B, Generation Time (s)=2.4526, Detection Time (ms)=44.52, Memory Usage (B)=1.32025.05 | 11.4777 | 1 | 0.845 | 1 | 0.9549 | — | — | — | — | — | — | — | — | — | |
| KGWBackbone=OPT-1.3B, Generation Time (s)=2.4901, Detection Time (ms)=33.81, Memory Usage (B)=02025.05 | 11.4994 | 0.99 | 0.805 | 0.995 | 0.9268 | — | — | — | — | — | — | — | — | — | |
| DiPmarkBackbone=OPT-1.3B, Generation Time (s)=2.5492, Detection Time (ms)=71.54, Memory Usage (B)=02025.05 | 11.5042 | 0.9975 | 0.725 | 0.9975 | 0.9138 | — | — | — | — | — | — | — | — | — | |
| SWEETBackbone=OPT-1.3B, Generation Time (s)=2.4667, Detection Time (ms)=44.27, Memory Usage (B)=1.32025.05 | 11.5065 | 0.9975 | 0.8225 | 0.9975 | 0.9501 | — | — | — | — | — | — | — | — | — | |
| UWBackbone=OPT-1.3B, Generation Time (s)=2.5486, Detection Time (ms)=71.3, Memory Usage (B)=02025.05 | 11.5854 | 1 | 0.7425 | 0.9975 | 0.9221 | — | — | — | — | — | — | — | — | — | |
| BiMark (10)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 97 | 4.08 | 91.1 | 4.13 | 86.6 | 4.1 | 82.9 | 4.1 | — | |
| BiMark (20)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 98.9 | 4.03 | 95.6 | 4.05 | 92.3 | 4.08 | 89.2 | 4.08 | — | |
| BiMark (5)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 93.4 | 4.14 | 85 | 4.12 | 80.7 | 4.12 | 77.3 | 4.17 | — | |
| HeRo1 (2)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 99.8 | 4.14 | 99.2 | 4.13 | 98 | 4.13 | 96.3 | 4.12 | — | |
| HeRo1 (3)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 99.8 | 4.1 | 99.4 | 4.1 | 98.6 | 4.14 | 97.4 | 4.14 | — | |
| HeRo2 (1,1)Symbolic Decoding=true, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 98.2 | 4.11 | 94.3 | 4.13 | 90.4 | 4.13 | 86.9 | 4.11 | — | |
| HeRo2 (2,1)Symbolic Decoding=true, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 98.9 | 4.13 | 96 | 4.14 | 93.1 | 4.13 | 90 | 4.14 | — | |
| HeRo2 (2,2)Symbolic Decoding=true, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 99.1 | 4.16 | 97 | 4.17 | 94 | 4.1 | 91.2 | 4.1 | — | |
| MPAC (1, 2.0)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 98.7 | 4.55 | 95 | 4.57 | 91.7 | 4.56 | 88.2 | 4.49 | — | |
| MPAC (2, 2.0)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 98.7 | 4.65 | 95.7 | 4.65 | 92 | 4.62 | 88.6 | 4.59 | — | |
| StealthInk (1)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 97.6 | 4.13 | 92 | 4.13 | 88.2 | 4.1 | 84.5 | 4.12 | — | |
| StealthInk (2)Symbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | 92.5 | 4.05 | 84.3 | 4.12 | 81.7 | 4.15 | 76.7 | 4.18 | — | |
| w/oSymbolic Decoding=false, Model=Llama2-7B, Generation Length=400 tokens2026.07 | — | — | — | — | — | — | 4.16 | — | 4.16 | — | 4.16 | — | 4.16 | — |