Watermarking on eli5-category (test)
1.313PPLGreedy Decoding
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Greedy DecodingModel=Gemma-7B-instruct2024.10 | 1.313 | 87.2 | — | — | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=5122024.10 | 1.61 | 81.4 | 93.2 | 73.1 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=10242024.10 | 1.61 | 81.4 | 93.2 | 72.9 | |
| KuditipudiModel=Gemma-7B-instruct2024.10 | 1.615 | 81.4 | 58.4 | 51 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=322024.10 | 1.615 | 81.2 | 92.8 | 71.9 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=5122024.10 | 1.615 | 81.5 | 90 | 66.7 | |
| AaronsonModel=Gemma-7B-instruct2024.10 | 1.619 | 81.4 | 61 | 57.8 | |
| Aaronson Cor.Model=Gemma-7B-instruct2024.10 | 1.619 | 81.4 | 93 | 70.9 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=162024.10 | 1.621 | 81.2 | 92.4 | 70.3 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=162024.10 | 1.621 | 81.2 | 87.5 | 63 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=42024.10 | 1.623 | 81.1 | 87 | 61.7 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=42024.10 | 1.623 | 81.3 | 82.1 | 57 | |
| Random SamplingModel=Gemma-7B-instruct2024.10 | 1.627 | 81.1 | — | — | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=322024.10 | 1.63 | 81 | 88.1 | 63.9 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=1, m=22024.10 | 1.631 | 81 | 77.1 | 53.6 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=50, m=162024.10 | 1.645 | 81 | 89.7 | 60.4 | |
| KirchenbauerModel=Gemma-7B-instruct, delta (δ)=0.52024.10 | 1.649 | 80.8 | 61.6 | 50.7 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=50, m=42024.10 | 1.652 | 80.8 | 80.5 | 52.6 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=10, m=162024.10 | 1.653 | 80.8 | 94.7 | 75 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=50, m=162024.10 | 1.653 | 80.8 | 79.4 | 53.5 | |
| Black-Box WatermarkingModel=Gemma-7B-instruct, k=10, m=42024.10 | 1.657 | 80.7 | 89.4 | 61.7 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=10, m=162024.10 | 1.662 | 80.6 | 89.6 | 64.4 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=50, m=42024.10 | 1.664 | 80.6 | 73.2 | 51.2 | |
| Recursive Black-Box WatermarkingModel=Gemma-7B-instruct, k=10, m=42024.10 | 1.665 | 80.5 | 84 | 56.2 | |
| KirchenbauerModel=Gemma-7B-instruct, delta (δ)=12024.10 | 1.673 | 80.3 | 72.1 | 52.3 | |
| KirchenbauerModel=Gemma-7B-instruct, delta (δ)=22024.10 | 1.836 | 78.2 | 87.8 | 63 | |
| KirchenbauerModel=Gemma-7B-instruct, delta (δ)=32024.10 | 2.159 | 74.3 | 95.3 | 78.5 | |
| KirchenbauerModel=Gemma-7B-instruct, delta (δ)=42024.10 | 2.847 | 68.3 | 98.3 | 90 |