Agentic Evaluation on GAIA
28.12AccuracyEFFGEN
Evaluation Results
| Method | Links | |
|---|---|---|
| EFFGENModel=Qwen2.5-32B-Instruct2026.01 | 28.12 | |
| EFFGENModel=Gemma 3 (27B)2026.01 | 25 | |
| AutoGenModel=Gemma 3 (27B)2026.01 | 21.87 | |
| EFFGENModel=GPT-OSS (20B)2026.01 | 21.87 | |
| EFFGENModel=Qwen2.5-7B-Instruct2026.01 | 21.87 | |
| AutogenModel=Qwen2.5-32B-Instruct2026.01 | 21.87 | |
| EFFGENModel=Gemma 3 (12B)2026.01 | 18.75 | |
| LangChainModel=Gemma 3 (27B)2026.01 | 18.75 | |
| EFFGENModel=Qwen2.5-14B-Instruct2026.01 | 18.75 | |
| LangChainModel=Qwen2.5-32B-Instruct2026.01 | 18.75 | |
| Raw ModelModel=Gemma 3 (27B)2026.01 | 15.62 | |
| SmolagentsModel=Gemma 3 (27B)2026.01 | 15.62 | |
| EFFGENModel=Qwen2.5-3B-Instruct2026.01 | 15.62 | |
| AutogenModel=Qwen2.5-14B-Instruct2026.01 | 15.62 | |
| Raw ModelModel=Qwen2.5-32B-Instruct2026.01 | 15.62 | |
| SmolagentsModel=Qwen2.5-32B-Instruct2026.01 | 15.62 | |
| EFFGENModel=Gemma 3 (4B)2026.01 | 12.5 | |
| Raw ModelModel=Gemma 3 (12B)2026.01 | 12.5 | |
| AutoGenModel=Gemma 3 (12B)2026.01 | 12.5 | |
| Raw ModelModel=GPT-OSS (20B)2026.01 | 12.5 | |
| AutoGenModel=GPT-OSS (20B)2026.01 | 12.5 | |
| Raw ModelModel=Qwen2.5-7B-Instruct2026.01 | 12.5 | |
| AutogenModel=Qwen2.5-7B-Instruct2026.01 | 12.5 | |
| Raw ModelModel=Qwen2.5-14B-Instruct2026.01 | 12.5 | |
| LangChainModel=Qwen2.5-14B-Instruct2026.01 | 12.5 | |
| EFFGENModel=Gemma 3 (1B)2026.01 | 9.38 | |
| LangChainModel=Gemma 3 (12B)2026.01 | 9.38 | |
| SmolagentsModel=Gemma 3 (12B)2026.01 | 9.38 | |
| LangChainModel=GPT-OSS (20B)2026.01 | 9.38 | |
| SmolagentsModel=GPT-OSS (20B)2026.01 | 9.38 | |
| EFFGENModel=Qwen2.5-1.5B-Instruct2026.01 | 9.38 | |
| SmolagentsModel=Qwen2.5-3B-Instruct2026.01 | 9.38 | |
| LangChainModel=Qwen2.5-3B-Instruct2026.01 | 9.38 | |
| SmolagentsModel=Qwen2.5-7B-Instruct2026.01 | 9.38 | |
| LangChainModel=Qwen2.5-7B-Instruct2026.01 | 9.38 | |
| SmolagentsModel=Qwen2.5-14B-Instruct2026.01 | 9.38 | |
| AutoGenModel=Gemma 3 (1B)2026.01 | 6.25 | |
| Raw ModelModel=Gemma 3 (4B)2026.01 | 6.25 | |
| LangChainModel=Gemma 3 (4B)2026.01 | 6.25 | |
| AutoGenModel=Gemma 3 (4B)2026.01 | 6.25 | |
| SmolagentsModel=Gemma 3 (4B)2026.01 | 6.25 | |
| AutogenModel=Qwen2.5-1.5B-Instruct2026.01 | 6.25 | |
| Raw ModelModel=Qwen2.5-3B-Instruct2026.01 | 6.25 | |
| AutogenModel=Qwen2.5-3B-Instruct2026.01 | 6.25 | |
| Raw ModelModel=Gemma 3 (1B)2026.01 | 3.12 | |
| LangChainModel=Gemma 3 (1B)2026.01 | 3.12 | |
| SmolagentsModel=Gemma 3 (1B)2026.01 | 3.12 | |
| Raw ModelModel=Qwen2.5-1.5B-Instruct2026.01 | 3.12 | |
| SmolagentsModel=Qwen2.5-1.5B-Instruct2026.01 | 3.12 | |
| LangChainModel=Qwen2.5-1.5B-Instruct2026.01 | 3.12 |