Retrieval on LoCo 4096 tokens V1
24.04NDCG@10KV-Embedding
Evaluation results
| Method | Links | |
|---|---|---|
| KV-EmbeddingBase Model=Llama-3.1-8B-Instruct2026.01 | 24.04 | |
| KV-EmbeddingBase Model=Mistral-7B-Instruct-v0.12026.01 | 20.68 | |
| KV-EmbeddingBase Model=Qwen3-4B2026.01 | 18.22 | |
| Token PrependingBase Model=Llama-3.1-8B-Instruct2026.01 | 13.97 | |
| EchoBase Model=Qwen3-4B2026.01 | 13.18 | |
| PromptEOLBase Model=Qwen3-4B2026.01 | 12.86 | |
| PromptEOLBase Model=Llama-3.1-8B-Instruct2026.01 | 12.85 | |
| Token PrependingBase Model=Qwen3-4B2026.01 | 12.55 | |
| EchoBase Model=Llama-3.1-8B-Instruct2026.01 | 11.91 | |
| Token PrependingBase Model=Mistral-7B-Instruct-v0.12026.01 | 9.92 | |
| EchoBase Model=Mistral-7B-Instruct-v0.12026.01 | 5.91 | |
| PromptEOLBase Model=Mistral-7B-Instruct-v0.12026.01 | 4.42 |