Information Retrieval on BEIR-7 Average
67.1NDCG@10 (Dense)DiffRetriever
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DiffRetrieverProtocol=Fine-tuned, Backbone=Dream, Variant=multi-token2026.05 | 67.1 | 53.7 | 64.7 | |
| PromptRepsProtocol=Fine-tuned, Backbone=Qwen2.5, Variant=multi-token2026.05 | 66.4 | 53 | 64 | |
| PromptRepsProtocol=Fine-tuned, Backbone=Qwen2.5, Variant=single-token2026.05 | 65.7 | 52 | 63.2 | |
| PromptRepsProtocol=Fine-tuned, Backbone=LLaMA-3, Variant=multi-token2026.05 | 65.5 | 52.6 | 63.3 | |
| DiffRetrieverProtocol=Fine-tuned, Backbone=Dream, Variant=single-token2026.05 | 65.4 | 51.5 | 62.9 | |
| PromptRepsProtocol=Fine-tuned, Backbone=LLaMA-3, Variant=single-token2026.05 | 65.1 | 51.2 | 62.3 | |
| DiffRetrieverProtocol=Fine-tuned, Backbone=LLaDA, Variant=multi-token2026.05 | 64.5 | 52.3 | 62.6 | |
| DiffRetrieverProtocol=Fine-tuned, Backbone=LLaDA, Variant=single-token2026.05 | 64.3 | 50.9 | 62.3 | |
| DiffEmbedProtocol=Fine-tuned, Backbone=Dream, Variant=single-vector2026.05 | 63.8 | — | — | |
| DiffEmbedProtocol=Fine-tuned, Backbone=LLaDA, Variant=single-vector2026.05 | 59.5 | — | — | |
| RepLLaMAProtocol=Fine-tuned, Backbone=LLaMA, Variant=single-vector2026.05 | 56.5 | — | — | |
| DiffRetrieverProtocol=Zero-shot, Backbone=LLaDA, Variant=multi-token2026.05 | 49.7 | 45.1 | 53.9 | |
| DiffRetrieverProtocol=Zero-shot, Backbone=LLaDA, Variant=single-token2026.05 | 44.6 | 43.2 | 51 | |
| DiffRetrieverProtocol=Zero-shot, Backbone=Dream, Variant=multi-token2026.05 | 42.7 | 37.6 | 47.6 | |
| PromptRepsProtocol=Zero-shot, Backbone=LLaMA-3, Variant=single-token2026.05 | 41.2 | 42.1 | 50.3 | |
| PromptRepsProtocol=Zero-shot, Backbone=LLaMA-3, Variant=multi-token2026.05 | 38.9 | 42.4 | 50 | |
| PromptRepsProtocol=Zero-shot, Backbone=Qwen2.5, Variant=multi-token2026.05 | 34.2 | 40 | 44.6 | |
| PromptRepsProtocol=Zero-shot, Backbone=Qwen2.5, Variant=single-token2026.05 | 32.1 | 40.1 | 44.1 | |
| DiffRetrieverProtocol=Zero-shot, Backbone=Dream, Variant=single-token2026.05 | 31.1 | 21.9 | 33.1 | |
| DiffEmbedProtocol=Zero-shot, Backbone=Dream, Variant=single-vector2026.05 | 30 | — | — | |
| DiffEmbedProtocol=Zero-shot, Backbone=LLaDA, Variant=single-vector2026.05 | 28.5 | — | — | |
| BM25Protocol=Zero-shot, Backbone=-, Variant=sparse2026.05 | — | 47.2 | — |