Open-domain Question Answering on NQ 3.5K (test)
0.261EMQNorm
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QNormRetriever=Contriever (fine-tuned on MS MARCO 80K), Reader=Flan-T5-Large, Similarity=QNorm2026.02 | 0.261 | 0.354 | |
| LearnRetriever=Contriever (fine-tuned on MS MARCO 80K), Reader=Flan-T5-Large, Similarity=Learn (learnable normalization)2026.02 | 0.25 | 0.34 | |
| DotRetriever=Contriever (fine-tuned on MS MARCO 80K), Reader=Flan-T5-Large, Similarity=Dot2026.02 | 0.245 | 0.338 | |
| CosineRetriever=Contriever (fine-tuned on MS MARCO 80K), Reader=Flan-T5-Large, Similarity=Cosine2026.02 | 0.23 | 0.319 | |
| DNormRetriever=Contriever (fine-tuned on MS MARCO 80K), Reader=Flan-T5-Large, Similarity=DNorm2026.02 | 0.228 | 0.315 |