General Assistant Tasks on GAIA (Level Breakdown Scores)
76.36Average ScoreFluxMem
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FluxMemModel=GPT-5-mini2026.05 | 76.36 | 88.68 | 75.58 | 53.85 | |
| MemEvolveModel=GPT-5-mini2026.05 | 73.33 | 83.02 | 73.26 | 53.85 | |
| AlitaModel=Claude-3.7-Sonnet,GPT-4o2026.05 | 72.73 | 81.13 | 75.58 | 46.15 | |
| LangfunModel=Claude 3.7 etc.2026.05 | 71.52 | 83.02 | 68.6 | 57.69 | |
| FluxMemModel=DeepSeek V3.22026.05 | 70.3 | 81.13 | 69.77 | 50 | |
| Flash-SearcherModel=GPT-5-mini2026.05 | 69.09 | 79.25 | 69.77 | 46.15 | |
| MemEvolveModel=DeepSeek V3.22026.05 | 67.88 | 83.02 | 63.95 | 50 | |
| OpenAI Deep ResearchModel=OpenAI o1, o3 etc.2026.05 | 67.36 | 74.29 | 69.06 | 47.6 | |
| FluxMemModel=Kimi K22026.05 | 64.85 | 77.36 | 62.79 | 46.15 | |
| Agent KBModel=GPT-4.12026.05 | 61.21 | 79.25 | 58.14 | 34.62 | |
| MemEvolveModel=Kimi K22026.05 | 61.21 | 67.92 | 63.95 | 38.46 | |
| Flash-SearcherModel=DeepSeek V3.22026.05 | 60.61 | 79.25 | 53.49 | 46.15 | |
| SmolagentsModel=GPT-5-mini2026.05 | 55.75 | 69.81 | 54.65 | 30.77 | |
| SmolagentsModel=GPT-4.12026.05 | 55.15 | 67.92 | 53.49 | 34.62 | |
| Flash-SearcherModel=Kimi K22026.05 | 52.12 | 58.49 | 52.33 | 34.62 | |
| Magnetic-1Model=OpenAI o1 etc.2026.05 | 46.06 | 56.6 | 46.51 | 23.08 |