Mathematical Reasoning on HLE Maths (Acc, Cost)
38.2AccuracyMAS-Zero
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MAS-ZeroLLM Backbone=GPT-52026.06 | 38.2 | 1,288.3 | |
| MAS-OrchestraLLM Backbone=GPT-52026.06 | 37.64 | 147.49 | |
| DyLANLLM Backbone=GPT-52026.06 | 35.51 | 115.1 | |
| MaASLLM Backbone=GPT-52026.06 | 35.32 | 221.2 | |
| ADASLLM Backbone=GPT-52026.06 | 34.6 | 846.9 | |
| MaASLLM Backbone=Gemini-2.5-Pro2026.06 | 34.52 | 248.78 | |
| CoT-SCLLM Backbone=GPT-52026.06 | 33.92 | 116.2 | |
| AFlowLLM Backbone=GPT-52026.06 | 32.73 | 784.6 | |
| DyLANLLM Backbone=Gemini-2.5-Pro2026.06 | 32.14 | 396.98 | |
| CoTLLM Backbone=GPT-52026.06 | 29.87 | 33.5 | |
| MAS-ZeroLLM Backbone=Gemini-2.5-Pro2026.06 | 29.5 | — | |
| ADASLLM Backbone=Gemini-2.5-Pro2026.06 | 27.98 | 1,896 | |
| CoT-SCLLM Backbone=Gemini-2.5-Pro2026.06 | 26.19 | 243.81 | |
| CoTLLM Backbone=Gemini-2.5-Pro2026.06 | 25.6 | 47.71 | |
| AFlowLLM Backbone=Gemini-2.5-Pro2026.06 | 19.05 | 302.59 | |
| MAS-ZeroLLM Backbone=GPT-OSS-120B2026.06 | 15.75 | 15.62 | |
| MaASLLM Backbone=GPT-OSS-120B2026.06 | 15.48 | 2.6 | |
| CoT-SCLLM Backbone=GPT-OSS-120B2026.06 | 13.89 | 3.9 | |
| AFlowLLM Backbone=GPT-OSS-120B2026.06 | 9.51 | 23 | |
| DyLANLLM Backbone=GPT-OSS-120B2026.06 | 9.32 | 1.6 | |
| MAS-OrchestraLLM Backbone=GPT-OSS-120B2026.06 | 9.32 | 2 | |
| CoTLLM Backbone=GPT-OSS-120B2026.06 | 8.73 | 0.3 | |
| ADASLLM Backbone=GPT-OSS-120B2026.06 | 7.93 | 1.9 | |
| CoT-SCLLM Backbone=GPT-4o2026.06 | 4.76 | 8.7 | |
| CoTLLM Backbone=GPT-4o2026.06 | 4.6 | 1.3 | |
| MaASLLM Backbone=GPT-4o2026.06 | 4.37 | 5.99 | |
| ADASLLM Backbone=GPT-4o2026.06 | 3.8 | 50.6 | |
| DyLANLLM Backbone=GPT-4o2026.06 | 3.57 | 12.9 | |
| MAS-OrchestraLLM Backbone=GPT-4o2026.06 | 3.37 | 9.3 | |
| MAS-ZeroLLM Backbone=GPT-4o2026.06 | 3.17 | 249.8 | |
| AFlowLLM Backbone=GPT-4o2026.06 | 2.77 | 292.6 |