List your company
ResearchFormerly WizWand

Mathematical Reasoning on AQuA (Accuracy)

93.55AccuracyProTeGi
76.826881.168485.5189.8516Oct 3, 2025Nov 9, 2025Dec 17, 2025Jan 24, 2026Mar 2, 2026Apr 9, 2026May 17, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ProTeGiBackbone Model=Gemini-2-Flash, Prompt Optimization Technique=ProTeGi2026.0593.55
PSAO_LLMBackbone Model=Gemini-2-Flash, Prompt Optimization Technique=PSAO_LLM2026.0593.42
COPROBackbone Model=Gemini-2-Flash, Prompt Optimization Technique=COPRO2026.0592.76
PSAO_LLMModel=GPT-4o2026.0592.65
PSAO_LLMLLM=GPT-4o2026.0592.65
PromptAgentBackbone Model=Gemini-2-Flash, Prompt Optimization Technique=PromptAgent2026.0592.24
CLoTBackbone=deepseek-v32026.0491.8
BaselineBackbone Model=Gemini-2-Flash, Prompt Optimization Technique=Baseline2026.0591.45
GEPABackbone Model=Gemini-2-Flash, Prompt Optimization Technique=GEPA2026.0590.13
MIPROBackbone Model=Gemini-2-Flash, Prompt Optimization Technique=MIPRO2026.0588.95
AgentReviveBase model=Deepseek-V3-671B-Instruct, Var. NS=true, Flex. State=true2026.0588.85
AgentDropoutBase model=Deepseek-V3-671B-Instruct, Var. NS=true, Flex. State=false2026.0588.33
C-CoTBackbone=deepseek-v32026.0488.1
ARG-DesignerBase model=Deepseek-V3-671B-Instruct, Var. NS=true, Flex. State=false2026.0587.96
AgentPruneBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0587.92
SC (CoT)Base model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0587.85
G-DesignerBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0587.61
MASround=TBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0587.5
CoT-SCBackbone=deepseek-v3, n=52026.0487.4
Hierarchical MASPrompt Opt.=false, Joint Opt.=false2026.0587.01
Hierarchical MAS + MASPOPrompt Opt.=true, Joint Opt.=true2026.0587.01
CLoTBackbone=gpt-42026.0486.9
AutoGenBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0586.71
MASround=1Base model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0586.67
Hierarchical MAS + SPOPrompt Opt.=true, Joint Opt.=false2026.0586.61
ARBackbone=deepseek-v32026.0486.6
DMoABackbone=gpt-oss-120b, Evaluation Paradigm=few-shot2026.0586.6
GoAgent2026.0386.45
Hierarchical MAS + TPEPrompt Opt.=true, Joint Opt.=false2026.0586.45
AgentDropoutPrompt Opt.=false, Joint Opt.=false2026.0586.23
AgentVerseBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0585.9
CLoTBackbone=gpt-4o-mini2026.0485.8
Sequential MAS + MASPOPrompt Opt.=true, Joint Opt.=true2026.0585.56
ARG-Designer2026.0385.51
CoTBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0585.42
Sequential MAS + TPEPrompt Opt.=true, Joint Opt.=false2026.0584.92
VanillaBase model=Deepseek-V3-671B-Instruct, Var. NS=false, Flex. State=false2026.0584.58
ISP-CoTBackbone=gpt-42026.0484.2
CoTBackbone=deepseek-v32026.0484.2
ISP-CoTBackbone=gpt-4o-mini2026.0483.7
Sequential MASPrompt Opt.=false, Joint Opt.=false2026.0583.47
EIB-LEARNER2026.0383.46
ATARBase Model=Qwen3-30B2025.1083.46
COPROModel=GPT-4o2026.0583.42
GEPALLM=GPT-4o2026.0583.42
COPROLLM=GPT-4o2026.0583.42
C-CoTBackbone=gpt-4o-mini2026.0483.3
PromptAgentLLM=GPT-4o2026.0583.29
CoT-SCBackbone=gpt-4o-mini, n=52026.0483.1
CoT-SCBackbone=gpt-4, n=52026.0483.1
RADARAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0582.84
CoTBackbone=gpt-42026.0482.7
C-CoTBackbone=gpt-42026.0482.7
STEERBackbone=gpt-oss-120b2026.0582.66
BaselineLLM=GPT-4o2026.0582.63
Self-RefinePrompt Opt.=false, Joint Opt.=false2026.0582.28
SC (COT×5)Autonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=12026.0582.28
SC (CoT)Prompt Opt.=false, Joint Opt.=false2026.0582.17
CoTPrompt Opt.=false, Joint Opt.=false2026.0581.89
MIPROModel=GPT-4o2026.0581.84
MIPROLLM=GPT-4o2026.0581.84
G-Designer2026.0381.6
AgentSquareAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0581.5
CoTBackbone=gpt-4o-mini2026.0481.4
SpecReasonBackbone=gpt-oss-120b2026.0581.36
ProTeGiLLM=GPT-4o2026.0581.32
Sequential MAS + SPOPrompt Opt.=true, Joint Opt.=false2026.0581.1
ARG-DesignerAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0581.1
AgentDropout2026.0380.94
AgentPruneAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0580.93
DALAAgent Category=Multi-Agent2025.1180.92
AFlowAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0580.9
G-DesignerAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0580.75
GPTSwarmAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0580.71
AgentPrune2026.0380.51
SafeSieveBackbone=gpt-oss-120b2026.0580.4
MaASAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0580.25
ATARBase Model=Qwen3-4B2025.1079.92
TrBackbone=gpt-42026.0479.9
SWIFTEvaluation Protocol=Out-of-distribution2026.0479.9
LLM-DebateAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=52026.0579.7
DyLANAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=52026.0579.59
VanillaPrompt Opt.=false, Joint Opt.=false2026.0579.53
ARBackbone=gpt-42026.0479.5
ARG-DesignerBackbone=gpt-oss-120b, Evaluation Paradigm=few-shot2026.0579.48
GTDAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0579.44
MultiPersonaAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=52026.0579.23
MacNetAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=52026.0579.23
ATARBase Model=Phi-42025.1079.13
LLM-BlenderAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=52026.0578.99
VanillaAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=12026.0578.92
AutoAgentsAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0578.65
AgentPrune-RAgent Category=Multi-Agent2025.1178.6
AFlowBackbone=gpt-oss-120b2026.0578.2
ADASAutonomous Topology=true, Base LLM=gpt-4o-mini, Number of Agents=52026.0577.71
LLM-Debate2026.0377.65
ComplexCoTAgent Category=Single-Agent2025.1177.58
LLM-DebateAgent Category=Multi-Agent2025.1177.52
ARBackbone=gpt-4o-mini2026.0477.5
AgentVerseAutonomous Topology=false, Base LLM=gpt-4o-mini, Number of Agents=52026.0577.47