Information Retrieval on TREC-DL aggregate (test)
57.52NDCG@10Supervised
Evaluation results
| Method | Links | |
|---|---|---|
| SupervisedBackbone=Contriever, Q/Doc=1, MS MARCO Documents=80k, Setting=Supervised2026.02 | 57.52 | |
| InPars-GBQBackbone=RetroMAE, Q/Doc=2, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 56.71 | |
| InPars-GBQBackbone=Contriever, Q/Doc=1, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis2026.02 | 56.33 | |
| SupervisedBackbone=RetroMAE, Q/Doc=1, MS MARCO Documents=80k, Setting=Supervised2026.02 | 56.26 | |
| InPars-GBQBackbone=RetroMAE, Q/Doc=3, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 56.08 | |
| InPars-GBQBackbone=RetroMAE, Q/Doc=1, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis2026.02 | 56.07 | |
| InPars-GBQBackbone=Contriever, Q/Doc=2, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 55.31 | |
| SAPBackbone=RetroMAE, Q/Doc=1, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis2026.02 | 54.53 | |
| InPars-GBQBackbone=Contriever, Q/Doc=3, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 54.35 | |
| SAPBackbone=RetroMAE, Q/Doc=3, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 54.3 | |
| SAPBackbone=RetroMAE, Q/Doc=2, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 54.12 | |
| OursBackbone=RetroMAE, Q/Doc=1, MS MARCO Documents=80k, Setting=Zero-shot LLM Query Synthesis2026.02 | 54 | |
| OursBackbone=Contriever, Q/Doc=2, MS MARCO Documents=80k, Setting=Zero-shot LLM Query Synthesis2026.02 | 53.97 | |
| OursBackbone=RetroMAE, Q/Doc=3, MS MARCO Documents=80k, Setting=Zero-shot LLM Query Synthesis2026.02 | 53.89 | |
| SAPBackbone=Contriever, Q/Doc=1, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis2026.02 | 53.53 | |
| SAPBackbone=Contriever, Q/Doc=3, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 53.42 | |
| OursBackbone=Contriever, Q/Doc=3, MS MARCO Documents=80k, Setting=Zero-shot LLM Query Synthesis2026.02 | 53.34 | |
| SAPBackbone=Contriever, Q/Doc=2, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 53.08 | |
| OursBackbone=Contriever, Q/Doc=1, MS MARCO Documents=80k, Setting=Zero-shot LLM Query Synthesis2026.02 | 52.94 | |
| OursBackbone=RetroMAE, Q/Doc=2, MS MARCO Documents=80k, Setting=Zero-shot LLM Query Synthesis2026.02 | 52.66 | |
| DRAMABackbone=RetroMAE, Q/Doc=1, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis2026.02 | 52.12 | |
| DRAMABackbone=RetroMAE, Q/Doc=3, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 51.71 | |
| DRAMABackbone=RetroMAE, Q/Doc=2, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 51.5 | |
| Ours (8k)Backbone=RetroMAE, Q/Doc=2, MS MARCO Documents=8k, Setting=Zero-shot LLM Query Synthesis2026.02 | 51.26 | |
| Ours (8k)Backbone=Contriever, Q/Doc=2, MS MARCO Documents=8k, Setting=Zero-shot LLM Query Synthesis2026.02 | 50.33 | |
| DRAMABackbone=Contriever, Q/Doc=2, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 50.1 | |
| DRAMABackbone=Contriever, Q/Doc=1, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis2026.02 | 49.61 | |
| Ours (8k)Backbone=RetroMAE, Q/Doc=5, MS MARCO Documents=8k, Setting=Zero-shot LLM Query Synthesis2026.02 | 49.37 | |
| Ours (8k)Backbone=Contriever, Q/Doc=5, MS MARCO Documents=8k, Setting=Zero-shot LLM Query Synthesis2026.02 | 48.86 | |
| DRAMABackbone=Contriever, Q/Doc=3, MS MARCO Documents=80k, Setting=Few-shot LLM Query Synthesis, Extension=Extended by authors2026.02 | 48.14 | |
| PretrainedBackbone=Contriever, Q/Doc=-, MS MARCO Documents=80k, Setting=Pretrained2026.02 | 41.68 | |
| PretrainedBackbone=RetroMAE, Q/Doc=-, MS MARCO Documents=80k, Setting=Pretrained2026.02 | 11.52 | |
| DRAGON-SBackbone=RetroMAE, Q/Doc=2, MS MARCO Documents=80k, Setting=Non-LLM Data Augmentation, Extension=Extended by authors2026.02 | 5.11 | |
| DRAGON-SBackbone=Contriever, Q/Doc=2, MS MARCO Documents=80k, Setting=Non-LLM Data Augmentation, Extension=Extended by authors2026.02 | 4.8 | |
| DRAGON-SBackbone=Contriever, Q/Doc=1, MS MARCO Documents=80k, Setting=Non-LLM Data Augmentation2026.02 | 4.1 | |
| DRAGON-SBackbone=RetroMAE, Q/Doc=1, MS MARCO Documents=80k, Setting=Non-LLM Data Augmentation2026.02 | 3.9 | |
| DRAGON-SBackbone=Contriever, Q/Doc=3, MS MARCO Documents=80k, Setting=Non-LLM Data Augmentation, Extension=Extended by authors2026.02 | 3.88 | |
| DRAGON-SBackbone=RetroMAE, Q/Doc=3, MS MARCO Documents=80k, Setting=Non-LLM Data Augmentation, Extension=Extended by authors2026.02 | 3.2 |