Text-based Question Answering on MuSiQue (EM, F1, R@k, #Tok)
3.6EMLatent Memory
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=5, Backbone=LLaMA-3.2-1B-Instruct2026.06 | 3.6 | 14.7 | 28.8 | 76 | |
| Full ContextGeneration LLM=Mistral-7B-Instruct2026.06 | 2.8 | 14.9 | — | 3,012 | |
| Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=1, Backbone=LLaMA-3.2-1B-Instruct2026.06 | 2.3 | 11.8 | 8.4 | 36 | |
| Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=2, Backbone=LLaMA-3.2-1B-Instruct2026.06 | 2.2 | 12.8 | 14.9 | 46 | |
| Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=5, Fine-tuned=true2026.06 | 2 | 14.3 | 30.8 | 280 | |
| BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.06 | 1.7 | 9.5 | 12.1 | 119 | |
| BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 1.7 | 10.7 | 22.4 | 250 | |
| Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 1.6 | 12.8 | 31.3 | 247 | |
| Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 1.6 | 13.4 | 34.8 | 262 | |
| Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=22026.06 | 1.5 | 11.2 | 18.5 | 126 | |
| xRAGGeneration LLM=Mistral-7B-Instruct2026.06 | 1.4 | 9.5 | — | 42 | |
| Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=2, Fine-tuned=true2026.06 | 1.4 | 12.1 | 16.5 | 133 | |
| LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=20%2026.06 | 1.3 | 10.3 | — | 708 | |
| Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=1, Fine-tuned=true2026.06 | 1.3 | 11.4 | 9.8 | 83 | |
| Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.06 | 1.2 | 11.1 | 16.9 | 119 | |
| Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.06 | 1 | 10.2 | 9.5 | 77 | |
| Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=12026.06 | 1 | 10.6 | 10.3 | 81 | |
| LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=10%2026.06 | 0.9 | 7.4 | — | 371 | |
| BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.06 | 0.9 | 8.1 | 6.9 | 75 | |
| CLaRa-16xGeneration LLM=Mistral-7B-Instruct, k=52026.06 | 0.7 | 6 | 22.3 | 119 | |
| LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=5%2026.06 | 0.5 | 5.5 | — | 191 |