Knowledge Evaluation on KMMLU (test)
68.6AccuracyLuckyStar 111B
Evaluation results
| Method | Links | |
|---|---|---|
| LuckyStar 111B2026.06 | 68.6 | |
| LuckyStar 111BQuantization=4-bit2026.06 | 67.9 | |
| Claude 3.7 Sonnet2026.06 | 67.9 | |
| Qwen3 235B A22B2026.06 | 67 | |
| GPT-4o2026.06 | 66.3 | |
| Command A2026.06 | 64.9 |