Watermarked Text Generation Latency on BOOKSUM Mistral-Small-3.1-24B-Base-2503 (test)
0.037Latency per Token (s/tok)KGW
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| KGWBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=transformers2026.05 | 0.037 | 0.91 | 1 | 24.52 | |
| MorphMarkBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=transformers2026.05 | 0.037 | 0.87 | 1 | 23.31 | |
| SynthIDBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=transformers2026.05 | 0.039 | 0.81 | 1 | 20.78 | |
| UPVBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=transformers2026.05 | 0.041 | 0.85 | 1 | 20.47 | |
| PMarkBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=vLLM2026.05 | 0.205 | 4.63 | 49.73 | 1,146.01 | |
| SAMARKBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=vLLM2026.05 | 0.218 | 4.61 | 47.44 | 1,080.97 | |
| EXPBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=transformers2026.05 | 0.279 | 5.71 | 1 | 21.06 | |
| k-SemStampBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=vLLM2026.05 | 0.361 | 6.65 | 65.05 | 1,255.72 | |
| SemStampBackbone=Mistral-Small-3.1-24B-Base-2503, Backend=vLLM2026.05 | 0.395 | 7.58 | 64.5 | 1,294.76 |