Mathematical Reasoning on Math (Acc., #Token)
72.1AccuracyGemini2.5-Flash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini2.5-FlashPrompt Instruction=CoQ Prompt2025.10 | 72.1 | 452.3 | |
| Gemini2.5-FlashPrompt Instruction=CoT Prompt2025.10 | 71.4 | 249.1 | |
| Gemini2.5-FlashPrompt Instruction=Base2025.10 | 68.2 | 172.8 | |
| Gemma3-12BPrompt Instruction=Curious CoQ2025.10 | 67.1 | 784.5 | |
| GPT-4o-miniPrompt Instruction=CoQ Prompt2025.10 | 65.8 | 415.5 | |
| Qwen2.5-7BPrompt Instruction=Curious CoQ2025.10 | 64.8 | 728.9 | |
| Gemma3-12BPrompt Instruction=Refined CoT2025.10 | 64.3 | 658.7 | |
| GPT-4o-miniPrompt Instruction=CoT Prompt2025.10 | 63.7 | 219.1 | |
| Gemma3-12BPrompt Instruction=Vanilla CoT2025.10 | 63.6 | 612.3 | |
| Gemma3-12BPrompt Instruction=Base2025.10 | 61.8 | 461.8 | |
| GPT-4o-miniPrompt Instruction=Base2025.10 | 59.5 | 148.7 | |
| Qwen2.5-7BPrompt Instruction=Vanilla CoT2025.10 | 54.6 | 575.6 | |
| Qwen2.5-7BPrompt Instruction=Refined CoT2025.10 | 54.2 | 560.9 | |
| Qwen2.5-7BPrompt Instruction=Base2025.10 | 52.4 | 315.9 | |
| Llama3-8BPrompt Instruction=Curious CoQ2025.10 | 39.6 | 672.4 | |
| Llama3-8BPrompt Instruction=Refined CoT2025.10 | 35.8 | 523.8 | |
| Llama3-8BPrompt Instruction=Vanilla CoT2025.10 | 34.2 | 445.6 | |
| Llama3-8BPrompt Instruction=Base2025.10 | 22.4 | 114.3 |