Text-based Question Answering on MuSiQue (val)
13.7EMQwen3-Emb-0.6B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-Emb-0.6BGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=52026.06 | 13.7 | 24.7 | 34.8 | 230 | |
| Dense RetrievalGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=52026.06 | 12.8 | 23.4 | 31.3 | 218 | |
| LLMLinguaGeneration LLM=Meta-Llama-3-8B-Instruct, Compression percentage=20%2026.06 | 11.6 | 21.8 | — | 492 | |
| Dense RetrievalGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=22026.06 | 9.9 | 19.9 | 17 | 106 | |
| Qwen3-Emb-0.6BGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=22026.06 | 9.8 | 20.4 | 18.5 | 112 | |
| BM25 RetrievalGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=52026.06 | 9.5 | 19.6 | 22.4 | 221 | |
| Latent MemoryGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=52026.06 | 8.7 | 19.2 | 30.1 | 73 | |
| Qwen3-Emb-0.6BGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=12026.06 | 8.1 | 18.2 | 10.3 | 73 | |
| BM25 RetrievalGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=22026.06 | 8 | 16.7 | 12.2 | 106 | |
| Dense RetrievalGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=12026.06 | 7.8 | 17.1 | 9.6 | 70 | |
| Latent MemoryGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=22026.06 | 7.3 | 16.9 | 15.5 | 46 | |
| LLMLinguaGeneration LLM=Meta-Llama-3-8B-Instruct, Compression percentage=10%2026.06 | 6.9 | 14.9 | — | 259 | |
| BM25 RetrievalGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=12026.06 | 6.2 | 14.2 | 7 | 69 | |
| Full ContextGeneration LLM=Meta-Llama-3-8B-Instruct2026.06 | 6 | 17.1 | — | 2,580 | |
| Latent MemoryGeneration LLM=Meta-Llama-3-8B-Instruct, Retrieval k=12026.06 | 5.8 | 14.6 | 8.7 | 37 | |
| LLMLinguaGeneration LLM=Meta-Llama-3-8B-Instruct, Compression percentage=5%2026.06 | 4.3 | 10.6 | — | 137 |