Information Retrieval on NQ (NDCG@10 Variants)
64.4NDCG@10 (Dense)DiffRetriever
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DiffRetrieverProtocol=Fine-tuned, Backbone=Dream, Variant=multi-token2026.05 | 64.4 | 45.8 | 59.6 | |
| PromptRepsProtocol=Fine-tuned, Backbone=LLaMA-3, Variant=multi-token2026.05 | 63.1 | 45.8 | 58.3 | |
| DiffEmbedProtocol=Fine-tuned, Backbone=Dream, Variant=single-vector2026.05 | 62.5 | — | — | |
| PromptRepsProtocol=Fine-tuned, Backbone=Qwen2.5, Variant=multi-token2026.05 | 62.3 | 45.3 | 58.2 | |
| RepLLaMAProtocol=Fine-tuned, Backbone=LLaMA, Variant=single-vector2026.05 | 62.2 | — | — | |
| DiffRetrieverProtocol=Fine-tuned, Backbone=LLaDA, Variant=multi-token2026.05 | 62.2 | 45.2 | 58.4 | |
| DiffRetrieverProtocol=Fine-tuned, Backbone=LLaDA, Variant=single-token2026.05 | 62 | 44.6 | 57.9 | |
| PromptRepsProtocol=Fine-tuned, Backbone=Qwen2.5, Variant=single-token2026.05 | 61.9 | 44.1 | 57.3 | |
| PromptRepsProtocol=Fine-tuned, Backbone=LLaMA-3, Variant=single-token2026.05 | 61.9 | 44.3 | 57.3 | |
| DiffRetrieverProtocol=Fine-tuned, Backbone=Dream, Variant=single-token2026.05 | 61.9 | 43.3 | 57.2 | |
| DiffEmbedProtocol=Fine-tuned, Backbone=LLaDA, Variant=single-vector2026.05 | 58.7 | — | — | |
| DiffRetrieverProtocol=Zero-shot, Backbone=LLaDA, Variant=multi-token2026.05 | 38.5 | 29.2 | 41.5 | |
| DiffRetrieverProtocol=Zero-shot, Backbone=Dream, Variant=multi-token2026.05 | 34.6 | 21.9 | 35.8 | |
| PromptRepsProtocol=Zero-shot, Backbone=LLaMA-3, Variant=single-token2026.05 | 33.1 | 29.3 | 41 | |
| PromptRepsProtocol=Zero-shot, Backbone=LLaMA-3, Variant=multi-token2026.05 | 30.1 | 27.6 | 37.9 | |
| DiffRetrieverProtocol=Zero-shot, Backbone=LLaDA, Variant=single-token2026.05 | 28.9 | 29.6 | 38.2 | |
| PromptRepsProtocol=Zero-shot, Backbone=Qwen2.5, Variant=multi-token2026.05 | 23.2 | 26.5 | 31.6 | |
| PromptRepsProtocol=Zero-shot, Backbone=Qwen2.5, Variant=single-token2026.05 | 15.6 | 26.1 | 30.2 | |
| DiffEmbedProtocol=Zero-shot, Backbone=Dream, Variant=single-vector2026.05 | 11.8 | — | — | |
| DiffRetrieverProtocol=Zero-shot, Backbone=Dream, Variant=single-token2026.05 | 11.7 | 10.2 | 15.3 | |
| DiffEmbedProtocol=Zero-shot, Backbone=LLaDA, Variant=single-vector2026.05 | 6.6 | — | — | |
| BM25Protocol=Zero-shot, Backbone=-, Variant=sparse2026.05 | — | 24.3 | — |