Planning on FORGE-BENCH
99Success Rate (SR)FORGE-7B-NP-MATH
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FORGE-7B-NP-MATHModel Category=Open-Source LLMs2026.05 | 99 | 32.3 | |
| FORGE-7B-NPModel Category=Open-Source LLMs2026.05 | 98.2 | 28.9 | |
| gpt-o3Model Category=Proprietary LLMs2026.05 | 74 | 65.1 | |
| DS-V3.1-ThinkingModel Category=Proprietary LLMs2026.05 | 61.9 | 54.3 | |
| Qwen3-235B-ThinkingModel Category=Proprietary LLMs2026.05 | 52 | 44.8 | |
| gpt-4o-2024-08-06Model Category=Proprietary LLMs2026.05 | 52 | 29.6 | |
| Qwen3-30B-A3BModel Category=Open-Source LLMs2026.05 | 44.5 | 36.9 | |
| Qwen2.5-32BModel Category=Open-Source LLMs2026.05 | 23.5 | 6.7 | |
| QWEN2.5-7B-SFTModel Category=Open-Source LLMs2026.05 | 22 | 16.8 | |
| Qwen3-32BModel Category=Open-Source LLMs2026.05 | 21.6 | 11.2 | |
| Qwen2.5-14BModel Category=Open-Source LLMs2026.05 | 17.5 | 4.9 | |
| InternLM3-8bModel Category=Open-Source LLMs2026.05 | 16 | 4.1 | |
| Qwen3-235B-InstructModel Category=Proprietary LLMs2026.05 | 15.5 | 8.3 | |
| Qwen2.5-3BModel Category=Open-Source LLMs2026.05 | 15.5 | 3.7 | |
| DS-R1-Qwen-32BModel Category=Open-Source LLMs2026.05 | 15.4 | 7.9 | |
| LLama3.1-8BModel Category=Open-Source LLMs2026.05 | 15 | 1.8 | |
| Qwen2.5-72BModel Category=Open-Source LLMs2026.05 | 6.5 | 2.1 | |
| DS-R1-Qwen-14BModel Category=Open-Source LLMs2026.05 | 4.5 | 1.4 | |
| Qwen2.5-7BModel Category=Open-Source LLMs2026.05 | 3.5 | 1 | |
| Qwen3-8BModel Category=Open-Source LLMs2026.05 | 3 | 1.2 | |
| DS-R1-Qwen-7BModel Category=Open-Source LLMs2026.05 | 0.5 | 0.1 |