Multiple Choice Questions on TinyMMLU
86.8AccuracyPA-GRPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PA-GRPOModel=Qwen3-32B2026.03 | 86.8 | 91.8 | 89 | |
| GRPOModel=Qwen3-32B2026.03 | 85.2 | 91.4 | 86 | |
| PIFModel=Qwen3-32B2026.03 | 84.3 | 92 | 88 | |
| UniBiasModel=Qwen3-32B2026.03 | 81 | 89.3 | 80 | |
| CalibraEvalModel=Qwen3-32B2026.03 | 80.3 | 83.3 | 85 | |
| PriDeModel=Qwen3-32B2026.03 | 79.9 | 84.1 | 84 | |
| BaseModel=Qwen3-32B2026.03 | 76.5 | 86 | 81 | |
| PIFModel=Qwen3-8B2026.03 | 75.1 | 81.4 | 75 | |
| PA-GRPOModel=Qwen3-8B2026.03 | 73.2 | 88.6 | 80 | |
| UniBiasModel=Qwen3-8B2026.03 | 71.3 | 81 | 74 | |
| PriDeModel=Qwen3-8B2026.03 | 68.9 | 79.9 | 78 | |
| PA-GRPOModel=Llama-3.1-8B2026.03 | 67.9 | 81.9 | 75 | |
| BaseModel=Qwen3-8B2026.03 | 67.4 | 79.6 | 72 | |
| GRPOModel=Llama-3.1-8B2026.03 | 67.3 | 77.9 | 73 | |
| CalibraEvalModel=Qwen3-8B2026.03 | 63.5 | 75.5 | 68 | |
| UniBiasModel=Llama-3.1-8B2026.03 | 61.1 | 76.5 | 65 | |
| PriDeModel=Llama-3.1-8B2026.03 | 59.7 | 69.5 | 58 | |
| PIFModel=Llama-3.1-8B2026.03 | 56.9 | 69.1 | 57 | |
| GRPOModel=Qwen3-8B2026.03 | 56.6 | 83.7 | 76 | |
| CalibraEvalModel=Llama-3.1-8B2026.03 | 55.6 | 72.1 | 62 | |
| BaseModel=Llama-3.1-8B2026.03 | 54.2 | 68.9 | 57 |