List your company
ResearchFormerly WizWand

Text-based Question Answering on 2WikiMultihopQA (EM/F1/R@k/#Tok)

5.1EMCLaRa-16x
0.2121.4812.754.019Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
CLaRa-16xGeneration LLM=Mistral-7B-Instruct, k=52026.065.116.226.5115
Full ContextGeneration LLM=Mistral-7B-Instruct2026.063.827.1—1,244
Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=5, Fine-tuned=true2026.063.825.971.3247
xRAGGeneration LLM=Mistral-7B-Instruct2026.063.517.6—38
Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=52026.0632464.3236
Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=5, Backbone=LLaMA-3.2-1B-Instruct2026.062.924.175.972
Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.062.722.558225
Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=2, Backbone=LLaMA-3.2-1B-Instruct2026.06222.849.442
Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=1, Backbone=LLaMA-3.2-1B-Instruct2026.061.820.627.632
Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=2, Fine-tuned=true2026.061.721.554.4119
LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=20%2026.061.418.4—286
Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=22026.061.219.847.7115
BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.06118.646.9221
Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.06117.937.6107
Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=1, Fine-tuned=true2026.060.91735.574
BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.060.715.829.2104
Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=12026.060.717.132.574
LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=10%2026.060.615.1—149
Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.060.615.823.367
LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=5%2026.060.413—81
BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.060.414.418.366