List your company

Reasoning on MATH, GSM8K, AQUA, AIME, AMC, MMLU, GPQA

82.15Average AccuracyMARSHAL
59.883665.664371.44577.2257Oct 17, 2025

Evaluation results

MethodLinks
MARSHALSetting=AutoGen (Cooperative), Variant=Generalist2025.1082.1595.294.5486.6166.6792.589.5350
MARSHALSetting=AutoGen (Cooperative), Variant=Kuhn Poker2025.1081.5495.894.3986.6163.3392.589.6548.48
MARSHALSetting=AutoGen (Cooperative), Variant=Mini Hanabi2025.1081.5494.494.5486.2266.679588.9844.95
MARSHALSetting=AutoGen (Cooperative), Variant=Tic-Tac-Toe2025.1080.1594.494.6987.01609089.5345.45
SPIRALSetting=AutoGen (Cooperative)2025.1080.0594.294.4786.616087.591.645.96
Qwen3-4BSetting=AutoGen (Cooperative)2025.1079.1493.494.6985.0456.6787.589.2147.47
MARSHALSetting=MAD (Competitive), Variant=Generalist2025.1075.9692.895.683.8646.678087.3645.45
MARSHALSetting=MAD (Competitive), Variant=Tic-Tac-Toe2025.1075.0192.296.0683.0743.3382.586.7641.12
MARSHALSetting=MAD (Competitive), Variant=Kuhn Poker2025.1074.5491.696.2182.684082.587.3941.41
MARSHALSetting=MAD (Competitive), Variant=Mini Hanabi2025.1073.791.495.682.6843.3377.587.0438.38
SPIRALSetting=MAD (Competitive)2025.1073.4191.695.4581.894077.587.0140.4
Qwen3-4BSetting=MAD (Competitive)2025.1072.4590.295.9180.71407587.4237.88
SPIRALSetting=Single Agent2025.1063.7587.594.851.236.78058.737.37
MARSHALSetting=Single Agent, Variant=Tic-Tac-Toe2025.1063.5489.195.246.54077.557.638.89
MARSHALSetting=Single Agent, Variant=Generalist2025.1062.7989.994.65233.37559.934.85
MARSHALSetting=Single Agent, Variant=Mini Hanabi2025.1062.0588.194.74843.36558.936.36
MARSHALSetting=Single Agent, Variant=Kuhn Poker2025.1061.3887.894.548.433.372.559.333.84
Qwen3-4BSetting=Single Agent2025.1060.7487.694.639.836.77057.139.39