Question Answering on Supply Chain Question Answering 1.0 (test) benchmark leaderboard · SOTA2 Research

Question Answering on Supply Chain Question Answering 1.0 (test)

0.8391AccuracyGPT-5-mini

Evaluation Results

Method	Links
GPT-5-mini2026.02		0.8391
GPT-52026.02		0.8391
GPT-4.12026.02		0.8276
Claude-4-Sonnet2026.02		0.8207
Claude-4-Opus2026.02		0.8069
Gemini-2.5-Pro2026.02		0.8069
Qwen3-Max2026.02		0.8069
Kimi-K2-Instruct2026.02		0.8068
GPT-4.1-mini2026.02		0.8046
Claude-3.5-Sonnet2026.02		0.8045
GPT-O3-mini2026.02		0.8023
Deepseek-V32026.02		0.7977
Claude-3.7-Sonnet2026.02		0.7816
Deepseek-R12026.02		0.7816
Qwen3-30B-A3B2026.02		0.7793
QwQ-32B2026.02		0.777
GPT-4o2026.02		0.7724
GPT-5-nano2026.02		0.7724
GPT-4.12026.02		0.6897
GPT-4.1-mini2026.02		0.6805
Claude-3.5-Sonnet2026.02		0.6781
Deepseek-V32026.02		0.6775
GPT-5-mini2026.02		0.669
Claude-4-Opus2026.02		0.667
Gemini-2.5-Pro2026.02		0.6667
Claude-4-Sonnet2026.02		0.6643
GPT-52026.02		0.6621
GPT-O3-mini2026.02		0.6506
Kimi-K2-Instruct2026.02		0.6483
Deepseek-R12026.02		0.6368
Claude-3.7-Sonnet2026.02		0.623
GPT-4o2026.02		0.6207
GPT-5-nano2026.02		0.6161
QwQ-32B2026.02		0.6
Qwen3-Max2026.02		0.5977
Qwen3-30B-A3B2026.02		0.5655
Gemini-2.5-Flash2026.02		0.4748
Gemini-2.5-Flash2026.02		0.2046