Question Answering on PopQA (F1)
59.9F1 ScoreQwen3-Embedding (8B)
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-Embedding (8B)Retrieval Category=Dense Retrieval, Reranker=Qwen3-Embedding (8B) + reranker2026.02 | 59.9 | |
| Qwen3-Embedding (8B)Retrieval Category=Dense Retrieval, Reranker=None2026.02 | 59.8 | |
| PANINIRetrieval Category=Proposed Method2026.02 | 57.56 | |
| BM25Retrieval Category=Sparse Retrieval, Reranker=BM25 + reranker2026.02 | 56.8 | |
| HippoRAGRetrieval Category=Structure-Augmented RAG2026.02 | 56.2 | |
| NV-Embed-v2 (7B)Retrieval Category=Dense Retrieval2026.02 | 55.8 | |
| HippoRAG 2Retrieval Category=Structure-Augmented RAG2026.02 | 55.7 | |
| RAPTORRetrieval Category=Structure-Augmented RAG2026.02 | 55.1 | |
| IRCoTRetrieval Category=Agentic Systems2026.02 | 53.8 | |
| IGPOBackbone=Qwen2.5-7B-Instruct2025.10 | 53.8 | |
| BM25Retrieval Category=Sparse Retrieval, Reranker=None2026.02 | 53 | |
| GraphRAGRetrieval Category=Structure-Augmented RAG2026.02 | 51.3 | |
| Search-R1Retrieval Category=Agentic Systems2026.02 | 49.7 | |
| GRPOBackbone=Qwen2.5-7B-Instruct2025.10 | 49.6 | |
| TIPSBackbone=Qwen-2.5-7B Instruct2026.03 | 49.26 | |
| PPOBackbone=Qwen2.5-7B-Instruct2025.10 | 48.7 | |
| PPOBackbone=Qwen-2.5-7B Instruct2026.03 | 47.62 | |
| TIPSBackbone=Qwen-2.5-3B Instruct2026.03 | 47.43 | |
| PPOBackbone=Qwen-2.5-3B Instruct2026.03 | 46.81 | |
| MT-PPOBackbone=Qwen-2.5-7B Instruct2026.03 | 46.45 | |
| GSPOBackbone=Qwen2.5-7B-Instruct2025.10 | 45.4 | |
| MT-PPOBackbone=Qwen-2.5-3B Instruct2026.03 | 44.83 | |
| Reinforce++Backbone=Qwen2.5-7B-Instruct2025.10 | 44.3 | |
| MT-GRPO*Backbone=Qwen-2.5-7B Instruct2026.03 | 44.11 | |
| RLOOBackbone=Qwen2.5-7B-Instruct2025.10 | 43.1 | |
| GRPOBackbone=Qwen-2.5-3B Instruct2026.03 | 43 | |
| GRPOBackbone=Qwen-2.5-7B Instruct2026.03 | 42.51 | |
| MT-GRPO*Backbone=Qwen-2.5-3B Instruct2026.03 | 40.4 | |
| NoneRetrieval Category=No Retrieval2026.02 | 22.7 | |
| LightRAGRetrieval Category=Structure-Augmented RAG2026.02 | 14.8 |