List your company
ResearchFormerly WizWand

Text-based Question Answering on MuSiQue (EM, F1, R@k, #Tok)

3.6EMLatent Memory
0.3761.2132.052.887Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=5, Backbone=LLaMA-3.2-1B-Instruct2026.063.614.728.876
Full ContextGeneration LLM=Mistral-7B-Instruct2026.062.814.9—3,012
Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=1, Backbone=LLaMA-3.2-1B-Instruct2026.062.311.88.436
Latent MemoryGeneration LLM=Mistral-7B-Instruct, k=2, Backbone=LLaMA-3.2-1B-Instruct2026.062.212.814.946
Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=5, Fine-tuned=true2026.06214.330.8280
BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.061.79.512.1119
BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.061.710.722.4250
Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=52026.061.612.831.3247
Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=52026.061.613.434.8262
Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=22026.061.511.218.5126
xRAGGeneration LLM=Mistral-7B-Instruct2026.061.49.5—42
Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=2, Fine-tuned=true2026.061.412.116.5133
LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=20%2026.061.310.3—708
Qwen3-Emb-0.6B-ftGeneration LLM=Mistral-7B-Instruct, k=1, Fine-tuned=true2026.061.311.49.883
Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=22026.061.211.116.9119
Dense RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.06110.29.577
Qwen3-Emb-0.6BGeneration LLM=Mistral-7B-Instruct, k=12026.06110.610.381
LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=10%2026.060.97.4—371
BM25 RetrievalGeneration LLM=Mistral-7B-Instruct, k=12026.060.98.16.975
CLaRa-16xGeneration LLM=Mistral-7B-Instruct, k=52026.060.7622.3119
LLMLinguaGeneration LLM=Mistral-7B-Instruct, Compression Rate=5%2026.060.55.5—191