Question Answering on Bamboogle 125 QA pairs
45.9EMBase Agent
Evaluation results
| Method | Links | |
|---|---|---|
| Base AgentBackbone=Qwen-2.5-14B-Instruct2025.10 | 45.9 | |
| Ft. AgentBackbone=Qwen-2.5-7B-Instruct2025.10 | 38.7 | |
| Base LLMBackbone=Qwen-2.5-14B-Instruct2025.10 | 37.9 | |
| Base LLMBackbone=Qwen-2.5-7B-Instruct2025.10 | 32.8 | |
| Naive RAGBackbone=Qwen-2.5-7B-Instruct2025.10 | 30.9 | |
| Base AgentBackbone=Qwen-2.5-7B-Instruct2025.10 | 30.7 | |
| Base AgentBackbone=Mistral-NeMo-8B-Instruct2025.10 | 29.3 | |
| Naive RAGBackbone=Qwen-2.5-14B-Instruct2025.10 | 29.1 | |
| Ft. AgentBackbone=Qwen-2.5-3B-Instruct2025.10 | 28.5 | |
| Base LLMBackbone=Qwen-2.5-3B-Instruct2025.10 | 26.1 | |
| Base LLMBackbone=Mistral-NeMo-8B-Instruct2025.10 | 24.3 | |
| Naive RAGBackbone=Mistral-NeMo-8B-Instruct2025.10 | 20.5 | |
| Base AgentBackbone=Qwen-2.5-3B-Instruct2025.10 | 19.5 | |
| Naive RAGBackbone=Qwen-2.5-3B-Instruct2025.10 | 18.1 |