Efficiency Average on Consolidated Benchmarks All
11.2Avg Execution Time (min)EFFGEN
Evaluation results
| Method | Links | |
|---|---|---|
| EFFGENModel=Qwen2.5 (1.5B)2026.01 | 11.2 | |
| EFFGENModel=Qwen2.5 (3B)2026.01 | 17.4 | |
| EFFGENModel=Qwen2.5 (7B)2026.01 | 17.7 | |
| EFFGENModel=Qwen2.5 (14B)2026.01 | 30.5 | |
| EFFGENModel=Qwen2.5 (32B)2026.01 | 48 | |
| AutoGenModel=Qwen2.5 (7B)2026.01 | 52.9 | |
| Raw ModelModel=Qwen2.5 (1.5B)2026.01 | 53.7 | |
| AutoGenModel=Qwen2.5 (1.5B)2026.01 | 53.7 | |
| Raw ModelModel=Qwen2.5 (7B)2026.01 | 58.1 | |
| LangChainModel=Qwen2.5 (1.5B)2026.01 | 70.5 | |
| Raw ModelModel=Qwen2.5 (3B)2026.01 | 72.9 | |
| SmolagentsModel=Qwen2.5 (1.5B)2026.01 | 81.2 | |
| AutoGenModel=Qwen2.5 (3B)2026.01 | 84.5 | |
| LangChainModel=Qwen2.5 (7B)2026.01 | 92.9 | |
| LangChainModel=Qwen2.5 (3B)2026.01 | 112.2 | |
| SmolagentsModel=Qwen2.5 (3B)2026.01 | 126.5 | |
| SmolagentsModel=Qwen2.5 (7B)2026.01 | 136.7 | |
| Raw ModelModel=Qwen2.5 (14B)2026.01 | 143.6 | |
| AutoGenModel=Qwen2.5 (14B)2026.01 | 163.9 | |
| Raw ModelModel=Qwen2.5 (32B)2026.01 | 180.1 | |
| SmolagentsModel=Qwen2.5 (14B)2026.01 | 187.7 | |
| AutoGenModel=Qwen2.5 (32B)2026.01 | 212.7 | |
| SmolagentsModel=Qwen2.5 (32B)2026.01 | 265.6 | |
| LangChainModel=Qwen2.5 (14B)2026.01 | 282 | |
| LangChainModel=Qwen2.5 (32B)2026.01 | 385.9 |