Multi-bit Watermarking on LLaMA2-7B 300 tokens (test)
7.0486PerplexityGumbel-max (MirrorMark)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gumbel-max (MirrorMark)Payload size (bits)=36, Number of tokens=3002026.01 | 7.0486 | 1 | 1 | 98.35 | |
| Gumbel-max (MirrorMark)Payload size (bits)=54, Number of tokens=3002026.01 | 7.1751 | 1 | 1 | 96.83 | |
| Non WatermarkPayload size (bits)=36, Number of tokens=3002026.01 | 7.2784 | — | — | — | |
| Non WatermarkPayload size (bits)=54, Number of tokens=3002026.01 | 7.2784 | — | — | — | |
| Tour-Wmean (MirrorMark)Payload size (bits)=54, Number of tokens=3002026.01 | 7.3295 | 1 | 1 | 94.91 | |
| Tour-Bayes (MirrorMark)Payload size (bits)=54, Number of tokens=3002026.01 | 7.3295 | 1 | 0.996 | 95.76 | |
| Tour-Wmean (MirrorMark)Payload size (bits)=36, Number of tokens=3002026.01 | 7.3706 | 0.999 | 0.992 | 97.32 | |
| Tour-Bayes (MirrorMark)Payload size (bits)=36, Number of tokens=3002026.01 | 7.3706 | 0.9992 | 0.996 | 98.11 | |
| StealthInkPayload size (bits)=36, Number of tokens=3002026.01 | 7.8241 | 0.9892 | 0.852 | 88.96 | |
| StealthInkPayload size (bits)=54, Number of tokens=3002026.01 | 7.895 | 0.989 | 0.89 | 84.15 | |
| MPACPayload size (bits)=36, Number of tokens=3002026.01 | 9.1951 | 0.9949 | 0.98 | 93.47 | |
| MPACPayload size (bits)=54, Number of tokens=3002026.01 | 9.3457 | 0.9962 | 0.984 | 89.28 | |
| RSBHPayload size (bits)=54, Number of tokens=3002026.01 | 32.8184 | 0.9989 | 0.998 | 99.28 | |
| RSBHPayload size (bits)=36, Number of tokens=3002026.01 | 32.8955 | 0.9998 | 0.998 | 100 |