Makespan Accuracy on AsyncPlan-XXL benchmark leaderboard · SOTA2 Research

Makespan Accuracy on AsyncPlan-XXL

98Accuracy (S5)GPT-5-mini

Evaluation Results

Method	Links
GPT-5-mini2026.05		98	100	98	94	66	38	10	4	2	0	0	0	43
DeepSeek-V4-Flash2026.05		98	96	94	68	6	0	0	0	0	0	0	0	30
Qwen3.6 35B A3B2026.05		98	84	98	100	90	88	74	78	66	44	32	22	73
Gemini-3-flash2026.05		98	100	100	100	100	98	98	100	96	100	96	96	98
GPT-5-mini2026.05		98	100	100	100	100	98	98	100	96	98	88	86	97
DeepSeek-V4-Flash2026.05		98	100	100	100	100	98	98	100	96	100	96	100	99
Qwen3.6 35B A3B2026.05		98	100	100	100	100	98	98	100	96	100	96	100	99
Qwen3.6 35B A3B2026.05		98	84	98	100	90	84	68	76	62	38	26	20	70
Gemini-3-flash2026.05		98	100	100	100	100	96	98	100	92	96	96	94	98
GPT-5-mini2026.05		98	100	100	100	100	96	98	96	82	76	45	41	86
GPT-5-mini2026.05		96	100	94	94	60	34	8	4	2	0	0	0	41
DeepSeek-V4-Flash2026.05		96	96	94	68	6	0	0	0	0	0	0	0	30
Gemini-3-flash2026.05		94	54	22	18	4	12	2	2	4	0	0	0	18
Gemini-3-flash2026.05		94	52	22	18	4	12	0	0	4	0	0	0	17
DeepSeek-V4-Flash2026.05		94	100	100	100	100	96	98	98	94	98	94	96	97
Qwen3.6 35B A3B2026.05		84	98	94	98	98	92	96	100	94	100	96	100	96
DeepSeek-V4-Flash2026.05		82	80	66	56	54	58	64	48	48	42	42	42	57
Gemini-3-flash2026.05		76	96	86	92	82	76	64	54	26	46	22	26	71
GPT-5-mini2026.05		41	66	56	40	36	32	52	38	20	22	10	10	35
Qwen3.6 35B A3B2026.05		41	44	42	40	38	28	2	10	10	10	8	0	23
GPT-5-mini2026.05		38	48	40	32	18	20	24	10	4	0	0	0	20
Gemini-3-flash2026.05		14	0	0	0	0	0	0	0	0	0	0	0	1
DeepSeek-V4-Flash2026.05		0	0	0	0	0	0	0	0	0	0	0	0	0
Qwen3.6 35B A3B2026.05		0	0	0	0	0	0	0	0	0	0	0	0	0