Retrieval on LoCo 2048 tokens V1
0.1838NDCG@10KV-Embedding
Evaluation results
| Method | Links | |
|---|---|---|
| KV-EmbeddingBase Model=Mistral-7B-Instruct-v0.12026.01 | 0.1838 | |
| KV-EmbeddingBase Model=Llama-3.1-8B-Instruct2026.01 | 0.1817 | |
| KV-EmbeddingBase Model=Qwen3-4B2026.01 | 0.1192 | |
| EchoBase Model=Qwen3-4B2026.01 | 0.0658 | |
| EchoBase Model=Mistral-7B-Instruct-v0.12026.01 | 0.0549 | |
| PromptEOLBase Model=Qwen3-4B2026.01 | 0.0438 | |
| Token PrependingBase Model=Qwen3-4B2026.01 | 0.0422 | |
| Token PrependingBase Model=Mistral-7B-Instruct-v0.12026.01 | 0.0422 | |
| Token PrependingBase Model=Llama-3.1-8B-Instruct2026.01 | 0.0422 | |
| PromptEOLBase Model=Llama-3.1-8B-Instruct2026.01 | 0.041 | |
| PromptEOLBase Model=Mistral-7B-Instruct-v0.12026.01 | 0.0407 | |
| EchoBase Model=Llama-3.1-8B-Instruct2026.01 | 0.0385 |