General Reasoning on Average (MATH500, MBPP, Text-to-SQL, QuaLITY)
61.6P@1Plan-Answer
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Plan-AnswerModel=Qwen3-8B, Decoding Strategy=Plan-Answer2025.12 | 61.6 | 520 | |
| Think-AnswerModel=Qwen3-8B, Decoding Strategy=Think-Answer2025.12 | 59 | 1,538 | |
| Plan-AnswerModel=Qwen3-4B, Decoding Strategy=Plan-Answer2025.12 | 58.8 | 516 | |
| Think-AnswerModel=Qwen3-4B, Decoding Strategy=Think-Answer2025.12 | 56.9 | 1,419 | |
| No ThinkingModel=Qwen3-8B, Decoding Strategy=No Thinking2025.12 | 54.8 | 0 | |
| No ThinkingModel=Qwen3-4B, Decoding Strategy=No Thinking2025.12 | 52.4 | 0 |