Chinese Language Knowledge and Reasoning on C-Eval
78.5Overall ScoreQwen3-4B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-4BParams=4B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 78.5 | |
| Qwen2.5-3BParams=3B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 74.65 | |
| Qwen2-1.5BParams=1.5B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 71.29 | |
| Qwen2.5-1.5BParams=1.5B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 68.63 | |
| Qwen3-1.7BParams=1.7B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 66.7 | |
| Qwen3-0.6BParams=0.6B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 57.03 | |
| YuLan-Mini-2.4BParams=2.4B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 52.32 | |
| SmolLM3-3BParams=3B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 50.84 | |
| PCMind-2.1-Kaiyuan-2BParams=2B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 46.3 | |
| Llama-3.2-3BParams=3B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 45.67 | |
| Gemma2-2BParams=2B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 41.35 | |
| SmolLM2-1.7BParams=1.7B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 35.06 | |
| OLMo-2-0425-1BParams=1B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 30.53 | |
| Llama-3.2-1BParams=1B, Shot setting=5 shot, Evaluation protocol=PPL2025.12 | 29.82 |