Graph Optimization on FORGE-BENCH
100Success Rate (SR)gpt-o3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gpt-o3Model Category=Proprietary LLMs2026.05 | 100 | 51.4 | |
| Qwen3-235B-ThinkingModel Category=Proprietary LLMs2026.05 | 100 | 55.8 | |
| Qwen3-235B-InstructModel Category=Proprietary LLMs2026.05 | 100 | 50.4 | |
| gpt-4o-2024-08-06Model Category=Proprietary LLMs2026.05 | 100 | 53 | |
| Qwen2.5-32BModel Category=Open-Source LLMs2026.05 | 100 | 51.7 | |
| FORGE-7B-NP-MATHModel Category=Open-Source LLMs2026.05 | 100 | 51.8 | |
| Qwen3-30B-A3BModel Category=Open-Source LLMs2026.05 | 99 | 51.2 | |
| Qwen3-32BModel Category=Open-Source LLMs2026.05 | 99 | 52.6 | |
| FORGE-7B-NPModel Category=Open-Source LLMs2026.05 | 99 | 53.8 | |
| DS-V3.1-ThinkingModel Category=Proprietary LLMs2026.05 | 98 | 77.1 | |
| Qwen3-8BModel Category=Open-Source LLMs2026.05 | 98 | 51 | |
| gpt-o3Model Category=Proprietary LLMs2026.05 | 97 | 86.4 | |
| DS-R1-Qwen-32BModel Category=Open-Source LLMs2026.05 | 96 | 48.6 | |
| QWEN2.5-7B-SFTModel Category=Open-Source LLMs2026.05 | 96 | 49.7 | |
| FORGE-7B-NPModel Category=Open-Source LLMs2026.05 | 93.1 | 46.6 | |
| gpt-o3Model Category=Proprietary LLMs2026.05 | 91.5 | 76.9 | |
| FORGE-7B-NP-MATHModel Category=Open-Source LLMs2026.05 | 91.3 | 51.3 | |
| Qwen2.5-72BModel Category=Open-Source LLMs2026.05 | 90 | 39.5 | |
| FORGE-7B-NPModel Category=Open-Source LLMs2026.05 | 89.7 | 27.8 | |
| FORGE-7B-NP-MATHModel Category=Open-Source LLMs2026.05 | 89 | 32.2 | |
| Qwen2.5-14BModel Category=Open-Source LLMs2026.05 | 89 | 44.3 | |
| DS-V3.1-ThinkingModel Category=Proprietary LLMs2026.05 | 88.8 | 79.9 | |
| DS-V3.1-ThinkingModel Category=Proprietary LLMs2026.05 | 86 | 78.2 | |
| InternLM3-8bModel Category=Open-Source LLMs2026.05 | 86 | 43.3 | |
| Qwen3-235B-ThinkingModel Category=Proprietary LLMs2026.05 | 82.3 | 70.7 | |
| Qwen3-30B-A3BModel Category=Open-Source LLMs2026.05 | 76.8 | 64.1 | |
| Qwen3-32BModel Category=Open-Source LLMs2026.05 | 70.7 | 57.6 | |
| Qwen2.5-7BModel Category=Open-Source LLMs2026.05 | 67 | 34 | |
| Qwen3-235B-ThinkingModel Category=Proprietary LLMs2026.05 | 66.7 | 62.9 | |
| Qwen3-235B-InstructModel Category=Proprietary LLMs2026.05 | 65.4 | 50.2 | |
| gpt-4o-2024-08-06Model Category=Proprietary LLMs2026.05 | 64.7 | 29.3 | |
| gpt-4o-2024-08-06Model Category=Proprietary LLMs2026.05 | 62.1 | 36.2 | |
| Qwen3-8BModel Category=Open-Source LLMs2026.05 | 57.5 | 45.4 | |
| Qwen3-30B-A3BModel Category=Open-Source LLMs2026.05 | 57.3 | 50.6 | |
| QWEN2.5-7B-SFTModel Category=Open-Source LLMs2026.05 | 56.8 | 43 | |
| DS-R1-Qwen-32BModel Category=Open-Source LLMs2026.05 | 53.9 | 39.9 | |
| Qwen3-235B-InstructModel Category=Proprietary LLMs2026.05 | 47 | 37.9 | |
| Qwen3-32BModel Category=Open-Source LLMs2026.05 | 44.7 | 39.3 | |
| Qwen2.5-72BModel Category=Open-Source LLMs2026.05 | 43.4 | 26.5 | |
| Qwen2.5-32BModel Category=Open-Source LLMs2026.05 | 41.2 | 21.8 | |
| Qwen2.5-14BModel Category=Open-Source LLMs2026.05 | 36.2 | 17.8 | |
| InternLM3-8bModel Category=Open-Source LLMs2026.05 | 35.7 | 16.8 | |
| Qwen2.5-32BModel Category=Open-Source LLMs2026.05 | 35.3 | 15.2 | |
| QWEN2.5-7B-SFTModel Category=Open-Source LLMs2026.05 | 35 | 29.3 | |
| DS-R1-Qwen-14BModel Category=Open-Source LLMs2026.05 | 34.8 | 29.2 | |
| Qwen2.5-72BModel Category=Open-Source LLMs2026.05 | 34.7 | 15.2 | |
| DS-R1-Qwen-14BModel Category=Open-Source LLMs2026.05 | 32 | 16.2 | |
| Qwen2.5-14BModel Category=Open-Source LLMs2026.05 | 30 | 11.5 | |
| Qwen2.5-7BModel Category=Open-Source LLMs2026.05 | 29.6 | 14.6 | |
| DS-R1-Qwen-32BModel Category=Open-Source LLMs2026.05 | 23.3 | 18.1 | |
| LLama3.1-8BModel Category=Open-Source LLMs2026.05 | 23 | 8 | |
| Qwen3-8BModel Category=Open-Source LLMs2026.05 | 22.7 | 16.8 | |
| DS-R1-Qwen-14BModel Category=Open-Source LLMs2026.05 | 18 | 13.4 | |
| LLama3.1-8BModel Category=Open-Source LLMs2026.05 | 15.1 | 5.8 | |
| InternLM3-8bModel Category=Open-Source LLMs2026.05 | 15 | 3.6 | |
| Qwen2.5-3BModel Category=Open-Source LLMs2026.05 | 13.8 | 4.9 | |
| Qwen2.5-7BModel Category=Open-Source LLMs2026.05 | 11 | 3.1 | |
| Qwen2.5-3BModel Category=Open-Source LLMs2026.05 | 7.7 | 2.9 | |
| DS-R1-Qwen-7BModel Category=Open-Source LLMs2026.05 | 6.3 | 1.9 | |
| Qwen2.5-3BModel Category=Open-Source LLMs2026.05 | 6 | 2.2 | |
| DS-R1-Qwen-7BModel Category=Open-Source LLMs2026.05 | 4.7 | 2.5 | |
| DS-R1-Qwen-7BModel Category=Open-Source LLMs2026.05 | 2 | 1 | |
| LLama3.1-8BModel Category=Open-Source LLMs2026.05 | 0 | 0 |