Math Reasoning (coding tools) on BeyondBench Easy
3.4Execution Time (min)EFFGEN
Evaluation results
| Method | Links | |
|---|---|---|
| EFFGENModel=Qwen2.5 (1.5B)2026.01 | 3.4 | |
| EFFGENModel=Qwen2.5 (3B)2026.01 | 5.1 | |
| EFFGENModel=Qwen2.5 (14B)2026.01 | 7.7 | |
| EFFGENModel=Qwen2.5 (7B)2026.01 | 8.7 | |
| EFFGENModel=Qwen2.5 (32B)2026.01 | 15.1 | |
| AutoGenModel=Qwen2.5 (1.5B)2026.01 | 15.8 | |
| SmolagentsModel=Qwen2.5 (7B)2026.01 | 17.9 | |
| Raw ModelModel=Qwen2.5 (1.5B)2026.01 | 18.6 | |
| Raw ModelModel=Qwen2.5 (3B)2026.01 | 19.9 | |
| AutoGenModel=Qwen2.5 (7B)2026.01 | 23.5 | |
| Raw ModelModel=Qwen2.5 (7B)2026.01 | 24.1 | |
| AutoGenModel=Qwen2.5 (32B)2026.01 | 24.8 | |
| Raw ModelModel=Qwen2.5 (14B)2026.01 | 41.6 | |
| AutoGenModel=Qwen2.5 (3B)2026.01 | 47.2 | |
| Raw ModelModel=Qwen2.5 (32B)2026.01 | 53.5 | |
| SmolagentsModel=Qwen2.5 (1.5B)2026.01 | 62.4 | |
| LangChainModel=Qwen2.5 (1.5B)2026.01 | 63.1 | |
| AutoGenModel=Qwen2.5 (14B)2026.01 | 82.2 | |
| SmolagentsModel=Qwen2.5 (14B)2026.01 | 82.6 | |
| SmolagentsModel=Qwen2.5 (3B)2026.01 | 83.5 | |
| LangChainModel=Qwen2.5 (3B)2026.01 | 85.4 | |
| SmolagentsModel=Qwen2.5 (32B)2026.01 | 109.6 | |
| LangChainModel=Qwen2.5 (7B)2026.01 | 146.4 | |
| LangChainModel=Qwen2.5 (14B)2026.01 | 470.1 | |
| LangChainModel=Qwen2.5 (32B)2026.01 | 710.1 |