Watermark Segmentation on Gumbel-max watermarking Setting S1
95.1IoUOracle
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OracleModel Name=facebook opt-125m (50272)2025.09 | 95.1 | 100 | 100 | 100 | 98.7 | 98.7 | |
| OracleModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 94.5 | 100 | 100 | 100 | 98.5 | 98.5 | |
| OracleModel Name=facebook opt-1.3b (50272)2025.09 | 94.4 | 99.8 | 99.8 | 99.8 | 98.5 | 98.4 | |
| OracleModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 94 | 99.5 | 99.5 | 99.5 | 98.2 | 98.1 | |
| WISERModel Name=facebook opt-125m (50272)2025.09 | 93.4 | 100 | 99.5 | 99.7 | 98 | 97.9 | |
| WISERModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 92.8 | 100 | 98.8 | 99.4 | 97.7 | 97.5 | |
| WISERModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 92.8 | 100 | 99.8 | 99.9 | 97.9 | 97.8 | |
| WISERModel Name=facebook opt-1.3b (50272)2025.09 | 92.1 | 100 | 99.5 | 99.7 | 97.6 | 97.4 | |
| OracleModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 92 | 99.8 | 99.8 | 99.8 | 97.8 | 97.7 | |
| OracleModel Name=google gemma-3-270m (262144)2025.09 | 91.6 | 98 | 98 | 98 | 97.6 | 97.4 | |
| WISERModel Name=google gemma-3-270m (262144)2025.09 | 90.3 | 96.5 | 96 | 96.2 | 95.3 | 95 | |
| WISERModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 88 | 100 | 99.8 | 99.9 | 96.5 | 96.1 | |
| AligatorModel Name=facebook opt-125m (50272)2025.09 | 74.5 | 41 | 98.5 | 57.9 | 94 | 93.3 | |
| WaterSeekerModel Name=facebook opt-125m (50272)2025.09 | 67.2 | 100 | 80.2 | 89 | 86.4 | 85 | |
| WaterSeekerModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 65.9 | 100 | 81.2 | 89.7 | 86.2 | 84.7 | |
| WaterSeekerModel Name=facebook opt-1.3b (50272)2025.09 | 65.7 | 100 | 80.7 | 89.3 | 86 | 84.6 | |
| WaterSeekerModel Name=google gemma-3-270m (262144)2025.09 | 64.6 | 97.3 | 78 | 86.6 | 85.4 | 83.8 | |
| WaterSeekerModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 62.1 | 100 | 76.5 | 86.7 | 84 | 82.4 | |
| AligatorModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 57.2 | 37.9 | 94 | 54 | 91.5 | 89.7 | |
| WaterSeekerModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 57 | 100 | 72 | 83.7 | 81.4 | 79.1 | |
| AligatorModel Name=google gemma-3-270m (262144)2025.09 | 53.9 | 25.2 | 92 | 39.5 | 88.1 | 86.3 | |
| AligatorModel Name=facebook opt-1.3b (50272)2025.09 | 51.4 | 24.5 | 93 | 38.8 | 89.4 | 87.4 | |
| SeedBSModel Name=facebook opt-125m (50272)2025.09 | 50 | 76 | 63 | 68.9 | 84.4 | 81.1 | |
| AligatorModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 48.5 | 23.7 | 93 | 37.8 | 89 | 86.8 | |
| SeedBSModel Name=meta-llama Meta-Llama-3-8B (128256)2025.09 | 38.3 | 64.5 | 51 | 57 | 76.8 | 72 | |
| SeedBSModel Name=facebook opt-1.3b (50272)2025.09 | 32.7 | 62.3 | 44.5 | 51.9 | 76.1 | 71 | |
| AligatorModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 31 | 22.6 | 75 | 34.8 | 82.3 | 78.8 | |
| SeedBSModel Name=princeton-nlp Sheared-LLaMA-1.3B (32000)2025.09 | 30.2 | 51.2 | 38.8 | 44.1 | 72.8 | 67.8 | |
| SeedBSModel Name=google gemma-3-270m (262144)2025.09 | 29.9 | 56.2 | 42 | 48.1 | 72.7 | 67.7 | |
| SeedBSModel Name=mistralai Mistral-7B-v0.1 (32000)2025.09 | 22 | 40.5 | 27.8 | 32.9 | 61.1 | 56.1 |