Multi-hop Question Answering on MuSiQue (OOD)
20.6EMRECON
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RECONBackbone=Qwen2.5-7B-Base, Training Protocol=PPO, RECON Stage=Stage 1 + Stage 22025.10 | 20.6 | — | |
| Search-R1Backbone=Qwen2.5-7B-Base, Training Protocol=PPO2025.10 | 19.6 | — | |
| EviOmniMethod Category=RAR, Compression Ratio=96.60x2025.07 | 18 | 55.5 | |
| CoTMethod Category=RAR, Compression Ratio=11.25x2025.07 | 16.01 | 53.05 | |
| RECONBackbone=Qwen2.5-7B-Base, Training Protocol=PPO, RECON Stage=Stage 2 Distillation-only2025.10 | 12.8 | — | |
| Rejection Sampling2025.10 | 12.3 | — | |
| FullMethod Category=WR, Compression Ratio=1.0x2025.07 | 11.75 | 48.89 | |
| FilCoMethod Category=VAR, Compression Ratio=67.50x2025.07 | 8.36 | 45.74 | |
| R1-base2025.10 | 8.3 | — | |
| RECONBackbone=Qwen2.5-3B-Base, Training Protocol=PPO, RECON Stage=Stage 1 + Stage 22025.10 | 8.2 | — | |
| LLMLingua-2Method Category=VAR, Compression Ratio=4.55x2025.07 | 7.7 | 45.46 | |
| IRCoT2025.10 | 7.2 | — | |
| R1-instruct2025.10 | 7.2 | — | |
| SFT2025.10 | 6.6 | — | |
| Search-o12025.10 | 5.8 | — | |
| RAG2025.10 | 5.8 | — | |
| RECONBackbone=Qwen2.5-3B-Base, Training Protocol=PPO, RECON Stage=Stage 2 Distillation-only2025.10 | 5.7 | — | |
| Search-R1Backbone=Qwen2.5-3B-Base, Training Protocol=PPO2025.10 | 4.9 | — | |
| Direct Inference2025.10 | 3.1 | — | |
| CoT2025.10 | 2.2 | — | |
| ZeroMethod Category=WR2025.07 | 1.82 | 41.92 |