Inference Time Consumption on GAIA
11.2Latency (Research And Data)LeechHijack
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LeechHijackModel=Qwen2025.12 | 11.2 | 58 | 34.4 | 9.5 | 38.4 | |
| NormalModel=Qwen2025.12 | 12.7 | 78.4 | 31.3 | 10.3 | 49.4 | |
| NormalModel=GPT2025.12 | 22.3 | 68.7 | 21 | 20.5 | 41.1 | |
| NormalModel=Gemini2025.12 | 24.2 | 85.4 | 34.7 | 22 | 55 | |
| LeechHijackModel=Gemini2025.12 | 28.6 | 76.7 | 34.7 | 26.7 | 51.8 | |
| LeechHijackModel=GPT2025.12 | 31.8 | 81.2 | 21.2 | 30.3 | 50.5 | |
| Hybrid (Pydantic-AI)MCP Tool=Normal2025.12 | 73.8 | 103.1 | 76.3 | 79.6 | 80 | |
| Hybrid (Pydantic-AI)MCP Tool=LeechHijack2025.12 | 98.2 | 86.1 | 102.7 | 110.9 | 81 | |
| Localized (OpenManus)MCP Tool=Normal2025.12 | 118.9 | 182.1 | 127.4 | 90.7 | 143.5 | |
| NormalModel=Deepseek2025.12 | 118.9 | 182.1 | 127.4 | 90.7 | 143.5 | |
| Cloud-Hosted (OpenManus)MCP Tool=LeechHijack2025.12 | 127.8 | 158 | 169.7 | 126.8 | 139.8 | |
| Cloud-Hosted (OpenManus)MCP Tool=Normal2025.12 | 128.6 | 146.4 | 152.4 | 103.8 | 129.7 | |
| Localized (OpenManus)MCP Tool=LeechHijack2025.12 | 138.1 | 183.3 | 160.4 | 119 | 150.6 | |
| LeechHijackModel=Deepseek2025.12 | 138.1 | 183.3 | 160.4 | 119 | 150.6 | |
| Hybrid (OWL)MCP Tool=LeechHijack2025.12 | 227.6 | 294.6 | 284.6 | 226.6 | 264.9 | |
| Hybrid (OWL)MCP Tool=Normal2025.12 | 279.3 | 330.6 | 333.9 | 299.9 | 305.3 |