Strategy Question Answering on StrategyQA (Accuracy, Drop, TC2b)
78.89AccuracyQwen3-32B (FP16)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-32B (FP16)Model=Qwen3-32B, Precision=FP162026.06 | 78.89 | — | — | |
| Qwen3-8B (FP16)Model=Qwen3-8B, Precision=FP162026.06 | 73.65 | — | — | |
| Qwen3-32B (+L)Model=Qwen3-32B, Precision=2-bit + loop rescue2026.06 | 73.51 | -5.53 | 99.85 | |
| Qwen3-32B (2bit)Model=Qwen3-32B, Precision=2-bit2026.06 | 73.36 | -5.53 | 99.85 | |
| Qwen3-32B (+P)Model=Qwen3-32B, Precision=2-bit + FP16 plan2026.06 | 73.22 | -5.53 | 99.85 | |
| Qwen3-32B (+P + L)Model=Qwen3-32B, Precision=2-bit + FP16 plan + loop rescue2026.06 | 72.93 | -5.53 | 99.85 | |
| Qwen3-8B (+P + L)Model=Qwen3-8B, Precision=2-bit + FP16 plan + loop rescue2026.06 | 68.56 | -10.91 | 81.08 | |
| Qwen3-8B (+L)Model=Qwen3-8B, Precision=2-bit + loop rescue2026.06 | 67.54 | -10.91 | 81.08 | |
| Qwen3-8B (+P)Model=Qwen3-8B, Precision=2-bit + FP16 plan2026.06 | 64.05 | -10.91 | 81.08 | |
| Qwen3-8B (2bit)Model=Qwen3-8B, Precision=2-bit2026.06 | 62.74 | -10.91 | 81.08 |