Trivia-style factoid Question Answering on TriviaQA (EM, F1, #Tok)
72.8Exact Match (EM)Qwen3-Emb-0.6B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-Emb-0.6Bk=5, Generator=Meta-Llama-3-8B-Instruct2026.06 | 72.8 | 80.9 | 221 | |
| Qwen3-Emb-0.6Bk=2, Generator=Meta-Llama-3-8B-Instruct2026.06 | 72.1 | 79.8 | 110 | |
| Qwen3-Emb-0.6Bk=1, Generator=Meta-Llama-3-8B-Instruct2026.06 | 71.9 | 79 | 70 | |
| Densek=5, Generator=Meta-Llama-3-8B-Instruct2026.06 | 71.7 | 79.2 | 171 | |
| Densek=2, Generator=Meta-Llama-3-8B-Instruct2026.06 | 71.2 | 78.3 | 85 | |
| BM25k=1, Generator=Meta-Llama-3-8B-Instruct2026.06 | 71 | 77.7 | 66 | |
| BM25k=5, Generator=Meta-Llama-3-8B-Instruct2026.06 | 71 | 78.3 | 226 | |
| BM25k=2, Generator=Meta-Llama-3-8B-Instruct2026.06 | 70.7 | 77.8 | 106 | |
| Densek=1, Generator=Meta-Llama-3-8B-Instruct2026.06 | 70.2 | 77.1 | 57 | |
| Latent Memoryk=1, Memory tokens=8, Generator=Meta-Llama-3-8B-Instruct2026.06 | 68.9 | 75.4 | 42 | |
| Latent Memoryk=2, Memory tokens=8, Generator=Meta-Llama-3-8B-Instruct2026.06 | 68.1 | 74.8 | 58 | |
| Latent Memoryk=5, Memory tokens=8, Generator=Meta-Llama-3-8B-Instruct2026.06 | 67.7 | 74.4 | 106 | |
| Latent Memoryk=1, Memory tokens=1, Generator=Meta-Llama-3-8B-Instruct2026.06 | 66.5 | 72.9 | 34 | |
| Latent Memoryk=2, Memory tokens=1, Generator=Meta-Llama-3-8B-Instruct2026.06 | 66.4 | 73 | 44 | |
| Latent Memoryk=5, Memory tokens=1, Generator=Meta-Llama-3-8B-Instruct2026.06 | 65.1 | 71.7 | 70 | |
| Full ContextGenerator=Meta-Llama-3-8B-Instruct2026.06 | 18.9 | 24.7 | 10,828 |