Multi-Agent Orchestration on IWG benchmark leaderboard · SOTA2 Research

Multi-Agent Orchestration on IWG

85.38LCS-F1Claude-4.5-Sonnet

Evaluation Results

Method	Links
Claude-4.5-Sonnet2026.05		85.38	29.31	57.35	66.17	97.19	60.83	83.52	77.18
Gemini-2.5-Pro2026.05		81.28	44.14	62.71	66.19	91.72	53.33	83.46	73.68
DeepSeek-V3.12026.05		80.12	29.69	54.91	66.54	74.58	42.89	76.51	65.13
Gemini-2.5-Flash2026.05		77.43	43.83	60.63	67.68	85.02	47.11	84.38	71.05
Llama4-maverick2026.05		67.19	36.14	51.67	67.5	76.39	39.33	79.3	65.63
Grok-42026.05		63.99	24.48	44.24	63.97	90.61	42.67	82.51	69.94
Llama3-405B2026.05		61.64	28.88	45.26	67	89.68	44	79.67	70.09
LongCat-Flash2026.05		58.31	33.33	45.82	64.38	78.55	39.56	82.11	66.15
MiniMax-M22026.05		57.18	32.29	44.74	66	65.37	37.11	82.33	62.7
GLM-4.62026.05		56.91	30.14	43.53	67.62	91.03	32.89	83.73	68.82
Grok-32026.05		55.95	32.33	44.14	69.7	87.29	40.89	76.35	68.56
Claude-3.5-haiku2026.05		51.35	30.62	40.99	69.95	65.48	31.78	74.17	60.35
GPT-4.12026.05		49.96	29.55	39.76	69.91	88.57	36.61	80.28	68.84
Qwen-Max2026.05		49.96	25.36	37.66	69.72	91.62	30.16	82.89	68.6
Qwen3-next-80B2026.05		45.32	20.67	33	62.69	84.98	32.89	78.89	64.86
Doubao-1.5-Pro2026.05		42.81	13.74	28.28	68.13	82.67	34.67	79.01	66.12
GPT-OSS-120B2026.05		41.43	12.21	26.82	68.63	70.48	21.67	76.95	59.43
Qwen-Plus2026.05		36.8	12.57	24.69	68.95	82.69	28.16	82.19	65.5
Kimi-K22026.05		36.54	10.12	23.33	69.37	95.21	32.89	79.2	69.17
Qwen3-235B2026.05		36.5	13.52	25.01	69.07	87.93	31.11	82.79	67.73
Llama4-scout2026.05		35.13	10.5	22.82	65.52	76.39	17.11	79.07	59.52
Doubao-Seed-1.62026.05		33.71	10.88	22.3	69.68	80.71	24	80.19	63.65
GPT-52026.05		33.27	11.71	22.49	62.51	92.65	25.11	76.45	64.18
o4-mini2026.05		32.81	10.76	21.79	69.76	76.6	26.22	76.43	62.25
DeepSeek-R12026.05		23.54	7.43	15.49	58.22	25.35	31.56	80.72	48.96