Multi-hop Question Answering on 2WikiMultiHopQA (val)
69.3Exact Match (EM)GRPO
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GRPOModel Size=Qwen3 4B2026.02 | 69.3 | — | — | — | — | 77.73 | 87.53 | |
| MBT-RModel Size=Qwen3 4B2026.02 | 68.26 | — | — | — | — | 77.92 | 87.25 | |
| MBT-SModel Size=Qwen3 4B2026.02 | 67.52 | — | — | — | — | 77.32 | 86.67 | |
| GRPOModel Size=Qwen3 1.7B2026.02 | 63.25 | — | — | — | — | 72.32 | 80.69 | |
| MBT-SModel Size=Qwen3 1.7B2026.02 | 62.85 | — | — | — | — | 72.37 | 80.66 | |
| MBT-RModel Size=Qwen3 1.7B2026.02 | 62.24 | — | — | — | — | 72.22 | 80.62 | |
| RSModel Size=Qwen3 1.7B2026.02 | 58.06 | — | — | — | — | 68.26 | 76.75 | |
| MBT-SModel Size=Qwen3 0.6B2026.02 | 57.78 | — | — | — | — | 67.05 | 73.32 | |
| MBT-RModel Size=Qwen3 0.6B2026.02 | 57.21 | — | — | — | — | 66.35 | 73.17 | |
| TokenSkipModel Size=Qwen3 1.7B2026.02 | 57 | — | — | — | — | 66.37 | 74.65 | |
| GRPOModel Size=Qwen3 0.6B2026.02 | 54.61 | — | — | — | — | 62.93 | 69.25 | |
| Apex-SearcherType=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 54 | — | — | — | — | — | — | |
| BaseModel Size=Qwen3 1.7B2026.02 | 52.23 | — | — | — | — | 61.65 | 69.59 | |
| BaseModel Size=Qwen3 4B2026.02 | 50.7 | — | — | — | — | 62.07 | 86.43 | |
| RSModel Size=Qwen3 4B2026.02 | 50.3 | — | — | — | — | 61.59 | 85.53 | |
| DecEx-RAGType=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 50 | — | — | — | — | — | — | |
| Apex-SearcherType=Agentic RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 49.4 | — | — | — | — | — | — | |
| TokenSkipModel Size=Qwen3 4B2026.02 | 49.36 | — | — | — | — | 59.87 | 83.42 | |
| PromptModel Size=Qwen3 4B2026.02 | 49.2 | — | — | — | — | 60.21 | 86.27 | |
| ReasonRAGType=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 43.6 | — | — | — | — | — | — | |
| PromptModel Size=Qwen3 1.7B2026.02 | 42.46 | — | — | — | — | 55.63 | 74.19 | |
| Search-R1-InstructType=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 41.4 | — | — | — | — | — | — | |
| LIMOProModel Size=Qwen3 4B2026.02 | 41.01 | — | — | — | — | 56.29 | 80.57 | |
| LIMOProModel Size=Qwen3 1.7B2026.02 | 39.15 | — | — | — | — | 54.7 | 76.43 | |
| StepSearch-instructType=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 36.6 | — | — | — | — | — | — | |
| RSModel Size=Qwen3 0.6B2026.02 | 36.23 | — | — | — | — | 47.04 | 55.42 | |
| ZeroSearch-instructType=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 35.2 | — | — | — | — | — | — | |
| BaseModel Size=Qwen3 0.6B2026.02 | 33.99 | — | — | — | — | 43.9 | 51.59 | |
| TokenSkipModel Size=Qwen3 0.6B2026.02 | 33.95 | — | — | — | — | 44.5 | 52.81 | |
| LIMOProModel Size=Qwen3 0.6B2026.02 | 32.88 | — | — | — | — | 48.3 | 68.39 | |
| StepSearch-instructType=Agentic RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 32 | — | — | — | — | — | — | |
| ZeroSearch-instructType=Agentic RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 30 | — | — | — | — | — | — | |
| PromptModel Size=Qwen3 0.6B2026.02 | 29.64 | — | — | — | — | 39.63 | 49.84 | |
| Search-R1-InstructType=Agentic RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 27.3 | — | — | — | — | — | — | |
| Direct InferenceType=Non-Retrieval, Backbone=Qwen2.5-7B-Instruct2026.03 | 25 | — | — | — | — | — | — | |
| Direct InferenceType=Non-Retrieval, Backbone=Qwen2.5-3B-Instruct2026.03 | 24.4 | — | — | — | — | — | — | |
| RAGType=Standard RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 23.5 | — | — | — | — | — | — | |
| RAGType=Standard RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 22.6 | — | — | — | — | — | — | |
| Search-o1Type=Agentic RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 21.8 | — | — | — | — | — | — | |
| Search-o1Type=Agentic RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 17.6 | — | — | — | — | — | — | |
| IRCoTType=Iterative RAG, Backbone=Qwen2.5-3B-Instruct2026.03 | 17.1 | — | — | — | — | — | — | |
| IRCoTType=Iterative RAG, Backbone=Qwen2.5-7B-Instruct2026.03 | 14.9 | — | — | — | — | — | — | |
| CoTType=Non-Retrieval, Backbone=Qwen2.5-7B-Instruct2026.03 | 11.1 | — | — | — | — | — | — | |
| CoTType=Non-Retrieval, Backbone=Qwen2.5-3B-Instruct2026.03 | 2.1 | — | — | — | — | — | — | |
| Base + toolsAugmentation=Information retrieval tool, Protocol=Agentic RAG pipeline2026.02 | — | 23 | 726 | — | — | — | — | |
| Base Qwen3-4BContext=Full context2026.02 | — | 65 | 1,214 | — | — | — | — | |
| LogicPoisonLLM=GPT-4o-mini, RAG Framework=Naive RAG2026.04 | — | — | — | 90 | 91.6 | — | — | |
| LogicPoisonLLM=GPT-4o-mini, RAG Framework=GraphRAG2026.04 | — | — | — | 78.4 | 95.6 | — | — | |
| LogicPoisonLLM=GPT-4o-mini, RAG Framework=GFM-RAG2026.04 | — | — | — | 71.6 | 76 | — | — | |
| LogicPoisonLLM=GPT-4o-mini, RAG Framework=HippoRAG22026.04 | — | — | — | 82.8 | 71.8 | — | — | |
| LogicPoisonLLM=Llama-3.1-8B, RAG Framework=Naive RAG2026.04 | — | — | — | 95.4 | 94.4 | — | — | |
| LogicPoisonLLM=Llama-3.1-8B, RAG Framework=GraphRAG2026.04 | — | — | — | 78.8 | 95 | — | — | |
| LogicPoisonLLM=Llama-3.1-8B, RAG Framework=GFM-RAG2026.04 | — | — | — | 74.2 | 85.6 | — | — | |
| LogicPoisonLLM=Llama-3.1-8B, RAG Framework=HippoRAG22026.04 | — | — | — | 77.4 | 74.2 | — | — | |
| LogicPoisonLLM=Qwen-3-32B, RAG Framework=Naive RAG2026.04 | — | — | — | 82.2 | 83.4 | — | — | |
| LogicPoisonLLM=Qwen-3-32B, RAG Framework=GraphRAG2026.04 | — | — | — | 78.6 | 93.2 | — | — | |
| LogicPoisonLLM=Qwen-3-32B, RAG Framework=GFM-RAG2026.04 | — | — | — | 71.4 | 79.8 | — | — | |
| LogicPoisonLLM=Qwen-3-32B, RAG Framework=HippoRAG22026.04 | — | — | — | 87.4 | 76.6 | — | — | |
| PoisonedRAGLLM=GPT-4o-mini, RAG Framework=Naive RAG2026.04 | — | — | — | 64.4 | 83.4 | — | — | |
| PoisonedRAGLLM=GPT-4o-mini, RAG Framework=GraphRAG2026.04 | — | — | — | 58.6 | 77.4 | — | — | |
| PoisonedRAGLLM=GPT-4o-mini, RAG Framework=GFM-RAG2026.04 | — | — | — | 57.2 | 56.6 | — | — | |
| PoisonedRAGLLM=GPT-4o-mini, RAG Framework=HippoRAG22026.04 | — | — | — | 74.8 | 70.4 | — | — | |
| PoisonedRAGLLM=Llama-3.1-8B, RAG Framework=Naive RAG2026.04 | — | — | — | 61.4 | 77.8 | — | — | |
| PoisonedRAGLLM=Llama-3.1-8B, RAG Framework=GraphRAG2026.04 | — | — | — | 54.8 | 73.2 | — | — | |
| PoisonedRAGLLM=Llama-3.1-8B, RAG Framework=GFM-RAG2026.04 | — | — | — | 42.2 | 37.2 | — | — | |
| PoisonedRAGLLM=Llama-3.1-8B, RAG Framework=HippoRAG22026.04 | — | — | — | 74.8 | 70 | — | — | |
| PoisonedRAGLLM=Qwen-3-32B, RAG Framework=Naive RAG2026.04 | — | — | — | 63 | 82.4 | — | — | |
| PoisonedRAGLLM=Qwen-3-32B, RAG Framework=GraphRAG2026.04 | — | — | — | 58 | 77 | — | — | |
| PoisonedRAGLLM=Qwen-3-32B, RAG Framework=GFM-RAG2026.04 | — | — | — | 58.8 | 37.6 | — | — | |
| PoisonedRAGLLM=Qwen-3-32B, RAG Framework=HippoRAG22026.04 | — | — | — | 75.8 | 73.6 | — | — | |
| SELFCESTMechanism=Spawn clones with retrieval key, Training=End-to-end reinforcement learning2026.02 | — | 70 | 644 | — | — | — | — |