Text-based Question Answering on 2WikiMultihopQA (EM/F1/R@k/#Tok)
5.1EMCLaRa-16x
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| CLaRa-16xGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 5.1 | 16.2 | 26.5 | 115 | |
| Full ContextGeneration LLM=Mistral-7B-Instruct2026.06 | 3.8 | 27.1 | — | 1,244 | |
| Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=5, Fine-tuned=true2026.06 | 3.8 | 25.9 | 71.3 | 247 | |
| xRAGGeneration LLM=Mistral-7B-Instruct2026.06 | 3.5 | 17.6 | — | 38 | |
| Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 3 | 24 | 64.3 | 236 | |
| Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=5, Backbone=LLaMA-3.2-1B-Instruct2026.06 | 2.9 | 24.1 | 75.9 | 72 | |
| Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 2.7 | 22.5 | 58 | 225 | |
| Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=2, Backbone=LLaMA-3.2-1B-Instruct2026.06 | 2 | 22.8 | 49.4 | 42 | |
| Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=1, Backbone=LLaMA-3.2-1B-Instruct2026.06 | 1.8 | 20.6 | 27.6 | 32 | |
| Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=2, Fine-tuned=true2026.06 | 1.7 | 21.5 | 54.4 | 119 | |
| LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=20%2026.06 | 1.4 | 18.4 | — | 286 | |
| Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=22026.06 | 1.2 | 19.8 | 47.7 | 115 | |
| BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 1 | 18.6 | 46.9 | 221 | |
| Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.06 | 1 | 17.9 | 37.6 | 107 | |
| Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=1, Fine-tuned=true2026.06 | 0.9 | 17 | 35.5 | 74 | |
| BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.06 | 0.7 | 15.8 | 29.2 | 104 | |
| Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=12026.06 | 0.7 | 17.1 | 32.5 | 74 | |
| LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=10%2026.06 | 0.6 | 15.1 | — | 149 | |
| Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.06 | 0.6 | 15.8 | 23.3 | 67 | |
| LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=5%2026.06 | 0.4 | 13 | — | 81 | |
| BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.06 | 0.4 | 14.4 | 18.3 | 66 |