Math Q&A on Olympiad
30.4AccuracyAutoMR
Evaluation results
| Method | Links | |
|---|---|---|
| AutoMRBackbone=Qwen, Skeleton Structure=DAG2025.10 | 30.4 | |
| MaASBackbone=Qwen, Skeleton Structure=Sequential2025.10 | 27.7 | |
| Meta-ReasonerBackbone=Qwen, Skeleton Structure=Sequential2025.10 | 27.4 | |
| MRPBackbone=Qwen, Skeleton Structure=-2025.10 | 26.6 | |
| CoTBackbone=Qwen, Skeleton Structure=Sequential2025.10 | 26.2 | |
| rStarBackbone=Qwen, Skeleton Structure=Tree2025.10 | 25.4 | |
| AutoMRBackbone=LLaMA, Skeleton Structure=DAG2025.10 | 17.4 | |
| rStarBackbone=LLaMA, Skeleton Structure=Tree2025.10 | 15.1 | |
| Meta-ReasonerBackbone=LLaMA, Skeleton Structure=Sequential2025.10 | 13.1 | |
| MaASBackbone=LLaMA, Skeleton Structure=Sequential2025.10 | 12.6 | |
| CoTBackbone=LLaMA, Skeleton Structure=Sequential2025.10 | 11.9 | |
| MRPBackbone=LLaMA, Skeleton Structure=-2025.10 | 11.6 | |
| Direct-I/OBackbone=Qwen, Skeleton Structure=-2025.10 | 5.5 | |
| Direct-I/OBackbone=LLaMA, Skeleton Structure=-2025.10 | 3.7 |