Output Equivalence on GLM4
96.7Exact MatchEQSPEC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EQSPECBatch Size=12025.10 | 96.7 | 98.1 | |
| EXSPECBatch Size=12025.10 | 96.7 | 98.1 | |
| EQSPECBatch Size=42025.10 | 96.5 | 98.3 | |
| Spec-1Batch Size=12025.10 | 96 | 98 | |
| EXSPECBatch Size=42025.10 | 95.2 | 97.7 | |
| Non-Spec-BatchBatch Size=42025.10 | 93.3 | 97.2 | |
| vLLM + SpecSpeculative Decoding=enabled2025.10 | 72.7 | 84.5 | |
| BSPBatch Size=12025.10 | 1 | 15.3 | |
| BSPBatch Size=42025.10 | 0.6 | 8.1 | |
| DSDBatch Size=12025.10 | 0 | 1 | |
| DSDBatch Size=42025.10 | 0 | 0.8 |