Question Answering on ARC Easy (Accuracy, Drop, TC2b)
94.82AccuracyQwen3-32B (+P)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-32B (+P)Model=Qwen3-32B, Precision=2-bit + FP16 plan2026.06 | 94.82 | -0.42 | 99.92 | |
| Qwen3-32B (FP16)Model=Qwen3-32B, Precision=FP162026.06 | 94.78 | — | — | |
| Qwen3-32B (+P + L)Model=Qwen3-32B, Precision=2-bit + FP16 plan + loop rescue2026.06 | 94.61 | -0.42 | 99.92 | |
| Qwen3-32B (2bit)Model=Qwen3-32B, Precision=2-bit2026.06 | 94.36 | -0.42 | 99.92 | |
| Qwen3-8B (FP16)Model=Qwen3-8B, Precision=FP162026.06 | 94.32 | — | — | |
| Qwen3-32B (+L)Model=Qwen3-32B, Precision=2-bit + loop rescue2026.06 | 94.19 | -0.42 | 99.92 | |
| Qwen3-8B (+P)Model=Qwen3-8B, Precision=2-bit + FP16 plan2026.06 | 89.31 | -9.18 | 85.77 | |
| Qwen3-8B (+P + L)Model=Qwen3-8B, Precision=2-bit + FP16 plan + loop rescue2026.06 | 88.34 | -9.18 | 85.77 | |
| Qwen3-8B (+L)Model=Qwen3-8B, Precision=2-bit + loop rescue2026.06 | 86.08 | -9.18 | 85.77 | |
| Qwen3-8B (2bit)Model=Qwen3-8B, Precision=2-bit2026.06 | 85.14 | -9.18 | 85.77 |