Mathematical Reasoning on AGIEval-MATH (test)
93.3AccuracyAgent 1
Evaluation results
| Method | Links | |
|---|---|---|
| Agent 1Controller Backbone=Qwen3-4B-Base, Agent 1 Model=Qwen3-30B-A3B-Instruct2026.05 | 93.3 | |
| Agent 1Controller Backbone=Qwen3-8B-Base, Agent 1 Model=Qwen3-30B-A3B-Instruct2026.05 | 93.3 | |
| Iterative Critique-and-Routing ControllerController Backbone=Qwen3-8B-Base2026.05 | 89.3 | |
| Iterative Critique-and-Routing ControllerController Backbone=Qwen3-4B-Base2026.05 | 87.8 | |
| Controller V2Controller Backbone=Qwen3-4B-Base2026.05 | 80.9 | |
| Router-R1Controller Backbone=Qwen3-4B-Base2026.05 | 79.8 | |
| Controller V2Controller Backbone=Qwen3-8B-Base2026.05 | 77.6 | |
| Random RouterController Backbone=Qwen3-4B-Base2026.05 | 73.7 | |
| Controller V1Controller Backbone=Qwen3-4B-Base2026.05 | 73.6 | |
| RouterDCController Backbone=Qwen3-4B-Base2026.05 | 73.6 | |
| Controller V1Controller Backbone=Qwen3-8B-Base2026.05 | 73.5 | |
| Agent 2Controller Backbone=Qwen3-4B-Base, Agent 2 Model=Qwen2.5-7B-Instruct2026.05 | 73.4 | |
| RoBERTa RouterController Backbone=Qwen3-4B-Base2026.05 | 72.9 | |
| Agent 2Controller Backbone=Qwen3-8B-Base, Agent 2 Model=Ministral-3-8B-Instruct2026.05 | 68.1 | |
| RouterDCController Backbone=Qwen3-8B-Base2026.05 | 65.4 | |
| Random RouterController Backbone=Qwen3-8B-Base2026.05 | 64 | |
| Router-R1Controller Backbone=Qwen3-8B-Base2026.05 | 63.8 | |
| RoBERTa RouterController Backbone=Qwen3-8B-Base2026.05 | 62.8 | |
| Agent 3Controller Backbone=Qwen3-4B-Base, Agent 3 Model=Qwen2.5-1.5B-Instruct2026.05 | 54.7 | |
| UPAVenue=-, Execution Engine=GPT-4o-mini2026.01 | 52.1 | |
| Step-BackVenue=ICLR 24, Execution Engine=GPT-4o-mini2026.01 | 47.5 | |
| OPROVenue=ICLR 24, Execution Engine=GPT-4o-mini2026.01 | 46.1 | |
| PromptBreederVenue=ICML 24, Execution Engine=GPT-4o-mini2026.01 | 45.9 | |
| SPOVenue=EMNLP 26, Execution Engine=GPT-4o-mini2026.01 | 45.3 | |
| CoTVenue=NeurIPS 22, Execution Engine=GPT-4o-mini2026.01 | 44.5 | |
| APEVenue=ICLR 23, Execution Engine=GPT-4o-mini2026.01 | 44.4 | |
| TextGradVenue=Nature 25, Execution Engine=GPT-4o-mini2026.01 | 44.4 | |
| IOVenue=-, Execution Engine=GPT-4o-mini2026.01 | 42.1 | |
| RaRVenue=arXiv 23, Execution Engine=GPT-4o-mini2026.01 | 42.1 | |
| PromptAgentVenue=ICLR 24, Execution Engine=GPT-4o-mini2026.01 | 41.4 | |
| Agent 3Controller Backbone=Qwen3-8B-Base, Agent 3 Model=Llama-3-2-1B-Instruct2026.05 | 26.5 |