Language Understanding on MMLU-Pro (Accuracy and Speedup)
47.5AccuracyDEMASK
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DEMASK2026.04 | 47.5 | 1.7 | |
| Token OrderTokens per step=12026.04 | 45.7 | 1.3 | |
| KLASS2026.04 | 45.7 | 1.3 | |
| Top-1Tokens per step=12026.04 | 45.5 | 1 | |
| EntropyTokens per step=12026.04 | 43.9 | 1 | |
| Token OrderTokens per step=22026.04 | 43.6 | 2.8 | |
| Top-1Tokens per step=22026.04 | 43.5 | 2 | |
| EntropyTokens per step=22026.04 | 39.7 | 2 |