Watermark segmentation on Permute-and-Flip watermarking (n=1000, K=5, short gaps S3) (test)
94.6IoUOracle
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OracleModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 94.6 | 99.7 | 99.7 | 99.7 | 99.5 | 99.5 | |
| OracleModel Name=facebook opt-125m (50272)2025.09 | 92.3 | 99.7 | 99.7 | 99.7 | 99.3 | 99.3 | |
| WISERModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 91.6 | 99 | 99.8 | 99.4 | 99.2 | 99.2 | |
| OracleModel Name=facebook opt-1.3b (50272)2025.09 | 91.1 | 99.5 | 99.5 | 99.5 | 99.2 | 99.1 | |
| OracleModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 90.3 | 98.9 | 98.9 | 98.9 | 99.1 | 99 | |
| OracleModel Name=google gemma-3-270m (262144)2025.09 | 89.3 | 97.4 | 97.4 | 97.4 | 98.9 | 98.8 | |
| WISERModel Name=facebook opt-125m (50272)2025.09 | 88.8 | 99.3 | 99.4 | 99.4 | 99.1 | 99 | |
| WISERModel Name=facebook opt-1.3b (50272)2025.09 | 87.9 | 98.6 | 99.5 | 99 | 98.9 | 98.8 | |
| WISERModel Name=google gemma-3-270m (262144)2025.09 | 87.6 | 98.8 | 99.6 | 99.2 | 99.1 | 99 | |
| WISERModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 87 | 98.2 | 98.4 | 98.3 | 98.7 | 98.6 | |
| OracleModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 85.9 | 98.2 | 98.2 | 98.2 | 98.7 | 98.6 | |
| WISERModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 83.4 | 97 | 98.3 | 97.7 | 98.5 | 98.3 | |
| AligatorModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 77.7 | 69.6 | 97.5 | 81.2 | 98.2 | 98 | |
| WaterSeekerModel Name=facebook opt-125m (50272)2025.09 | 67.1 | 100 | 80.2 | 89 | 95.9 | 95.5 | |
| AligatorModel Name=facebook opt-125m (50272)2025.09 | 66.5 | 35.7 | 95.2 | 51.9 | 97.5 | 97.1 | |
| WaterSeekerModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 64.8 | 100 | 76.7 | 86.8 | 93.3 | 92.8 | |
| WaterSeekerModel Name=facebook opt-1.3b (50272)2025.09 | 64 | 100 | 76.1 | 86.4 | 95.6 | 95 | |
| AligatorModel Name=google gemma-3-270m (262144)2025.09 | 61.6 | 39 | 92.1 | 54.8 | 97.1 | 96.7 | |
| WaterSeekerModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 61 | 100 | 73.2 | 84.5 | 93.6 | 93 | |
| WaterSeekerModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 58.6 | 100 | 68.4 | 81.2 | 92.8 | 92.1 | |
| WaterSeekerModel Name=google gemma-3-270m (262144)2025.09 | 56.9 | 100 | 65.5 | 79.2 | 91.4 | 90.7 | |
| SeedBSModel Name=facebook opt-125m (50272)2025.09 | 45.6 | 80.7 | 31.7 | 45.5 | 90 | 88.6 | |
| SeedBSModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 44.6 | 77.5 | 26.9 | 39.9 | 86.6 | 85.2 | |
| SeedBSModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 44.5 | 83.1 | 51.8 | 63.8 | 94.2 | 93 | |
| SeedBSModel Name=google gemma-3-270m (262144)2025.09 | 40.9 | 76.7 | 31.4 | 44.6 | 88.7 | 87.5 | |
| SeedBSModel Name=facebook opt-1.3b (50272)2025.09 | 40.8 | 70.5 | 25.2 | 37.1 | 86.1 | 84.7 | |
| AligatorModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 40.6 | 26.8 | 80.3 | 40.1 | 94.5 | 93.7 | |
| AligatorModel Name=facebook opt-1.3b (50272)2025.09 | 39.4 | 23.5 | 84.1 | 36.7 | 95.1 | 94.3 | |
| SeedBSModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 36.4 | 70.3 | 23.4 | 35.1 | 81.4 | 80 | |
| AligatorModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 32.7 | 28.1 | 71.4 | 40.4 | 91.6 | 90.6 |