List your company
ResearchFormerly WizWand

Multi-agent system task solving on plancraft

88.7AccuracyTacoMAS
29.73245.04160.3575.659May 10, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TacoMASEvolution Time Scale=Topology-capability co-evolution, Base LLM=Gemini-2.5-flash-lite, Meta-LLM=Gemini-2.5-pro, Rubric Judge=GPT-4o-mini2026.0588.7
SwarmAgenticEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0581.2
EvoAgentXEvolution Time Scale=Offline-evolved, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0576.3
AFlowEvolution Time Scale=Offline-evolved, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0571.7
SelfOrgEvolution Time Scale=Within-instance evolution, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0571.2
MAS-IndependentEvolution Time Scale=Fixed-topology, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0571
MetaGPTEvolution Time Scale=Offline-evolved, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0566.8
AgentVerseEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0565.3
ARG-DesignerEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0561.9
MAS-DecentralizedEvolution Time Scale=Fixed-topology, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0560
AgentSquareEvolution Time Scale=Offline-evolved, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0557.4
MetaAgentEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0556
MAS-CentralizedEvolution Time Scale=Fixed-topology, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0556
ChatDev-PuppeteerEvolution Time Scale=Within-instance evolution, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0555.3
MAS-HybridEvolution Time Scale=Fixed-topology, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0554
SASEvolution Time Scale=Fixed-topology, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0553
ADASEvolution Time Scale=Offline-evolved, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0549.7
MaASEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0549.2
MetaGenEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0547.9
CORALEvolution Time Scale=Within-instance evolution, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0545.8
EvolveRouterEvolution Time Scale=Per-instance graph design, Base LLM=Gemini-2.5-flash-lite, Rubric Judge=GPT-4o-mini2026.0532