Execution Time on LoCoMo
21.7Execution Time (min)EFFGEN
Evaluation Results
| Method | Links | |
|---|---|---|
| EFFGENModel=Qwen2.5 (1.5B)2026.01 | 21.7 | |
| Raw ModelModel=Qwen2.5 (3B)2026.01 | 22.1 | |
| Raw ModelModel=Qwen2.5 (1.5B)2026.01 | 25.5 | |
| EFFGENModel=Qwen2.5 (3B)2026.01 | 28 | |
| EFFGENModel=Qwen2.5 (7B)2026.01 | 30.1 | |
| Raw ModelModel=Qwen2.5 (7B)2026.01 | 35.8 | |
| EFFGENModel=Qwen2.5 (14B)2026.01 | 58.1 | |
| Raw ModelModel=Qwen2.5 (14B)2026.01 | 64.7 | |
| LangChainModel=Qwen2.5 (1.5B)2026.01 | 66.3 | |
| AutoGenModel=Qwen2.5 (1.5B)2026.01 | 70.8 | |
| EFFGENModel=Qwen2.5 (32B)2026.01 | 91.2 | |
| Raw ModelModel=Qwen2.5 (32B)2026.01 | 109 | |
| AutoGenModel=Qwen2.5 (7B)2026.01 | 110 | |
| SmolagentsModel=Qwen2.5 (1.5B)2026.01 | 110.9 | |
| LangChainModel=Qwen2.5 (7B)2026.01 | 143.1 | |
| LangChainModel=Qwen2.5 (3B)2026.01 | 147.4 | |
| LangChainModel=Qwen2.5 (14B)2026.01 | 148.5 | |
| AutoGenModel=Qwen2.5 (3B)2026.01 | 157.7 | |
| AutoGenModel=Qwen2.5 (14B)2026.01 | 184.9 | |
| SmolagentsModel=Qwen2.5 (3B)2026.01 | 246.6 | |
| SmolagentsModel=Qwen2.5 (7B)2026.01 | 254 | |
| LangChainModel=Qwen2.5 (32B)2026.01 | 285.8 | |
| SmolagentsModel=Qwen2.5 (14B)2026.01 | 304.9 | |
| AutoGenModel=Qwen2.5 (32B)2026.01 | 314.4 | |
| SmolagentsModel=Qwen2.5 (32B)2026.01 | 495.4 |