Multimodal Agent Task on GAIA
47.17Success Rate (Level 1)HF Agent
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| HF AgentController=GPT-4o2025.04 | 47.17 | 31.4 | 11.54 | 33.4 | |
| SPORT AgentController=Tuned-Qwen2-VL-7B2025.04 | 35.85 | 16.28 | 3.84 | 20.61 | |
| HF AgentController=GPT-4o-mini2025.04 | 33.96 | 27.91 | 3.84 | 26.06 | |
| Warm-up AgentController=GPT-4-turbo2025.04 | 30.2 | 15.1 | 0 | 17.6 | |
| T3-AgentController=MAT-MiniCPM-V-8.5B2025.04 | 26.42 | 11.63 | 3.84 | 15.15 | |
| T3-AgentController=MAT-Qwen2-VL-7B2025.04 | 26.42 | 15.12 | 3.84 | 16.97 | |
| HF AgentController=Qwen2-VL-7B2025.04 | 16.98 | 8.14 | 0 | 9.7 | |
| HF AgentController=MiniCPM-V-8.5B2025.04 | 13.21 | 5.81 | 0 | 7.27 | |
| HF AgentController=LLaVA-NeXT-8B2025.04 | 9.43 | 1.16 | 0 | 3.64 | |
| HF AgentController=InternVL2-8B2025.04 | 7.55 | 4.65 | 0 | 4.85 |