Multi-hop Reasoning on HotpotQA (EM/F1)
55F1 ScoreBGE-reranker
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BGE-reranker2026.03 | 55 | 42 | 51 | |
| MergeRAG-Sym2026.03 | 55 | 43.5 | 51.5 | |
| MergeRAG-Asym2026.03 | 55 | 40 | 53.5 | |
| Prompt-R1Backbone=GPT-4o-mini2025.11 | 52.31 | 44.53 | — | |
| CoT ReasoningBackbone=GPT-4o-mini2025.11 | 49.7 | 42.97 | — | |
| RAPTOR2026.03 | 48.9 | 34.5 | 44 | |
| GEPAOptimization Framework=APO, Backbone=GPT-4o-mini2025.11 | 47.03 | 38.28 | — | |
| OPROOptimization Framework=APO, Backbone=GPT-4o-mini2025.11 | 46.83 | 34.38 | — | |
| BM252026.03 | 46.7 | 35.5 | 42.5 | |
| RECOMP2026.03 | 44.4 | 31 | 40 | |
| BaselineBackbone=GPT-4o-mini2025.11 | 40.07 | 33.59 | — | |
| TextGradOptimization Framework=APO, Backbone=GPT-4o-mini2025.11 | 37.1 | 27.34 | — | |
| Tree-RAG2026.03 | 36.2 | 27.5 | 30.8 | |
| GRPOBackbone=Qwen3-4B2025.11 | 32.27 | 27.34 | — | |
| SFTBackbone=Qwen3-4B2025.11 | 31.09 | 23.44 | — | |
| BaselineBackbone=Qwen3-4B2025.11 | 24.25 | 21.09 | — | |
| CoT ReasoningBackbone=Qwen3-4B2025.11 | 22.98 | 18.75 | — | |
| Soft-NBCEMem=O(L^2/n), zero-shot=false, distillation=true2026.05 | 0.479 | — | — | |
| Soft-NBCEMem=O(L^2/n), zero-shot=true, distillation=false2026.05 | 0.454 | — | — | |
| Vanilla NBCEMem=O(L^2/n)2026.05 | 0.427 | — | — | |
| PCWMem=O(L^2/n)2026.05 | 0.405 | — | — | |
| Truncated (8K)Mem=O(L^2)2026.05 | 0.402 | — | — | |
| AgentsCategory=Static-Prompting2026.04 | — | — | 37.5 | |
| AutoPECategory=Self-Evolving2026.04 | — | — | 39.8 | |
| Best-of-16Strategy=Best-of-16, Inference Budget=C=162026.03 | — | — | 82.5 | |
| CoTCategory=Static-Prompting2026.04 | — | — | 38.8 | |
| CoT2-MetaStrategy=Ours (CoT2-Meta), Inference Budget=C=162026.03 | — | — | 90.4 | |
| DSPyCategory=Self-Evolving2026.04 | — | — | 43.9 | |
| Greedy CoTStrategy=Greedy CoT, Inference Budget=C=162026.03 | — | — | 78.5 | |
| LangMARLCategory=Ours2026.04 | — | — | 60.2 | |
| ReflexionCategory=Self-Evolving2026.04 | — | — | 59.1 | |
| ReST-MCTS*Strategy=ReST-MCTS*, Inference Budget=C=162026.03 | — | — | 87.4 | |
| SymbolicCategory=Self-Evolving2026.04 | — | — | 44.8 | |
| TextGradCategory=Self-Evolving2026.04 | — | — | 57.3 | |
| Vanilla ToTStrategy=Vanilla ToT, Inference Budget=C=162026.03 | — | — | 85.1 |