Question Answering on SQuAD (F1 and Time)
0.839F1 ScoreUnwatermarked
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| UnwatermarkedBase Model=Ministral3-8B2026.05 | 0.839 | 1 | |
| De-markBase Model=Ministral3-8B2026.05 | 0.832 | 36.42 | |
| WASHBase Model=Ministral3-8B, n=52026.05 | 0.821 | 1.3 | |
| WASHBase Model=Ministral3-8B, n=42026.05 | 0.807 | 1.3 | |
| WASHBase Model=Ministral3-8B, n=32026.05 | 0.805 | 1.19 | |
| UnwatermarkedBase Model=Llama3.1-8B2026.05 | 0.795 | 1 | |
| Watermarked BaselineBase Model=Ministral3-8B2026.05 | 0.795 | 1 | |
| ToBlendBase Model=Ministral3-8B2026.05 | 0.775 | 15.92 | |
| WASHBase Model=Llama3.1-8B, n=42026.05 | 0.765 | 1.53 | |
| WASHBase Model=Llama3.1-8B, n=32026.05 | 0.764 | 1.49 | |
| WASHBase Model=Llama3.1-8B, n=52026.05 | 0.764 | 1.54 | |
| Watermarked BaselineBase Model=Llama3.1-8B2026.05 | 0.749 | 1 | |
| De-markBase Model=Llama3.1-8B2026.05 | 0.642 | 32.5 | |
| ToBlendBase Model=Llama3.1-8B2026.05 | 0.633 | 17.55 | |
| WASHBase Model=Qwen3-8B, n=42026.05 | 0.629 | 1.82 | |
| WASHBase Model=Qwen3-8B, n=52026.05 | 0.612 | 1.96 | |
| WASHBase Model=Qwen3-8B, n=32026.05 | 0.61 | 1.69 | |
| ToBlendBase Model=Qwen3-8B2026.05 | 0.474 | 19.18 | |
| De-markBase Model=Qwen3-8B2026.05 | 0.434 | 30.98 | |
| UnwatermarkedBase Model=Qwen3-8B2026.05 | 0.421 | 1 | |
| Watermarked BaselineBase Model=Qwen3-8B2026.05 | 0.396 | 1 |