Mathematical Reasoning on Omni-MATH (Accuracy and CoT Deltas)
32.2Accuracy (Omni-MATH)OctoTools
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OctoToolsBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Mathematical, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 32.2 | 5.2 | 2.9 | |
| OctoToolsbaseBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Mathematical, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 30.2 | — | — | |
| CoTBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Mathematical, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 29.3 | — | — | |
| 0-shotBackbone=gpt-4o-2024-08-06, Modality=Text, Domain=Mathematical, Visual Understanding=false, Numerical Calculation=true, Knowledge Retrieval=true, Multi-step Reasoning=true2025.02 | 27 | — | — |