Watermark Segmentation on Permute-and-Flip watermarking Setting S2
97.5IOUOracle
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OracleModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 97.5 | 100 | 100 | 100 | 99.7 | 99.7 | |
| OracleModel Name=facebook opt-125m (50272)2025.09 | 96.3 | 99.9 | 99.9 | 99.9 | 99.5 | 99.5 | |
| WISERModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 96.3 | 100 | 99.9 | 99.9 | 99.6 | 99.6 | |
| WISERModel Name=facebook opt-125m (50272)2025.09 | 95.9 | 99.4 | 99.9 | 99.6 | 99.5 | 99.4 | |
| OracleModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 95.5 | 99.9 | 99.9 | 99.9 | 99.4 | 99.3 | |
| WISERModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 95.4 | 99.8 | 99.6 | 99.7 | 99.3 | 99.3 | |
| OracleModel Name=facebook opt-1.3b (50272)2025.09 | 93.8 | 99.4 | 99.4 | 99.4 | 99 | 98.9 | |
| WISERModel Name=facebook opt-1.3b (50272)2025.09 | 92.7 | 99.2 | 99 | 99.1 | 98.7 | 98.5 | |
| OracleModel Name=google gemma-3-270m (262144)2025.09 | 92.6 | 100 | 100 | 100 | 99 | 98.9 | |
| WISERModel Name=google gemma-3-270m (262144)2025.09 | 91.6 | 97.7 | 99.6 | 98.6 | 98.8 | 98.7 | |
| OracleModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 90 | 98.9 | 98.9 | 98.9 | 98.4 | 98.2 | |
| WISERModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 89.4 | 98.2 | 98.5 | 98.4 | 97.7 | 97.5 | |
| AligatorModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 86.2 | 54.7 | 96.1 | 69.7 | 98.6 | 98.5 | |
| AligatorModel Name=facebook opt-125m (50272)2025.09 | 77.9 | 21.6 | 97.9 | 35.3 | 96.9 | 96.5 | |
| AligatorModel Name=google gemma-3-270m (262144)2025.09 | 56.4 | 14.2 | 93.8 | 24.6 | 92.6 | 91.6 | |
| AligatorModel Name=facebook opt-1.3b (50272)2025.09 | 55 | 13.7 | 91.7 | 23.9 | 92.7 | 91.6 | |
| AligatorModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 52.2 | 11.9 | 92.8 | 21.1 | 94.7 | 93.6 | |
| WaterSeekerModel Name=google gemma-3-270m (262144)2025.09 | 51.7 | 88.2 | 84.4 | 86.3 | 90.6 | 89.3 | |
| WaterSeekerModel Name=facebook opt-125m (50272)2025.09 | 51.6 | 84.3 | 80.3 | 82.2 | 90.6 | 89.5 | |
| WaterSeekerModel Name=facebook opt-1.3b (50272)2025.09 | 51.3 | 84.9 | 78.9 | 81.8 | 88.9 | 87.7 | |
| WaterSeekerModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 50.6 | 84.4 | 75 | 79.4 | 89.2 | 88 | |
| WaterSeekerModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 48.5 | 82.8 | 67.1 | 74.1 | 87.3 | 86.1 | |
| WaterSeekerModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 46.3 | 84.6 | 57.7 | 68.6 | 84.9 | 83.6 | |
| AligatorModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 45.2 | 15.5 | 83.6 | 26.1 | 92 | 90.6 | |
| SeedBSModel Name=facebook opt-125m (50272)2025.09 | 43.4 | 83.7 | 92.5 | 87.9 | 96.7 | 93.8 | |
| SeedBSModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 42.6 | 81.4 | 89.9 | 85.4 | 98.1 | 95 | |
| SeedBSModel Name=google gemma-3-270m (262144)2025.09 | 41.9 | 83.8 | 84.7 | 84.2 | 94.1 | 91.1 | |
| SeedBSModel Name=facebook opt-1.3b (50272)2025.09 | 39.8 | 83.6 | 84.9 | 84.2 | 94.1 | 91 | |
| SeedBSModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 39.8 | 86.1 | 85 | 85.6 | 95.8 | 92.6 | |
| SeedBSModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 35.1 | 83.8 | 79.7 | 81.7 | 93.3 | 90.1 |