List your company
ResearchFormerly WizWand

Document Retrieval on NQ 320k (test)

63.4Hits@1GENRE*-CONTRA
-2.452814.643631.7448.8364Oct 5, 2022Nov 9, 2022Dec 14, 2022Jan 18, 2023Feb 22, 2023Mar 29, 2023May 3, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GENRE*-CONTRABackbone=T5-large, Decoding=Np Decoding (CONTRA)2022.1063.481.1
GENRE*-BASEBackbone=T5-large, Decoding=Np Decoding (BASE)2022.1062.278.8
DSINaive-CONTRADecoding=Np Decoding (CONTRA), Identifier=Naively structured identifiers2022.1060.475.8
DSINaive-BASEDecoding=Np Decoding (BASE), Identifier=Naively structured identifiers2022.1058.773.1
GENRE*Backbone=T5-large, Decoding=Vanilla2022.1053.764.7
DSIsemanticIdentifier=Semantic identifiers2022.1035.662.6
TCT-ColBERTModel Size=Base2023.0524.1171.97
DSI-QG-Multi (sem)Model Size=Base, Task=Retrv, semantic IDs=true2023.0523.9271.35
DSI-QG-Multi (sem)Model Size=Base, Task=Index, semantic IDs=true2023.0523.972.02
DSI-QG-MultiModel Size=Large, Task=Retrv2023.0522.8571.1
Sentence-T52022.1022.463.3
DSI-QGModel Size=Large, Task=Index2023.0522.2351.89
DSI-QG-MultiModel Size=Large, Task=Index2023.0522.0663.04
DSI-QGModel Size=Base, Task=Index2023.0521.9351.8
DSI-QG-MultiModel Size=Base, Task=Index2023.0521.961.38
DSI-QG-MultiModel Size=Base, Task=Retrv2023.0521.6270.03
NCI (sem)Model Size=Base, Task=Index, semantic IDs=true2023.0521.269.99
SEALModel Size=Base2023.0513.7756.79
DSINaiveIdentifier=Naively structured identifiers2022.1013.333.6
BM252022.1011.634.4
BM252023.058.3433.36
DSIModel Size=Large, Task=Index2023.050.574.93
DSIModel Size=Base, Task=Index2023.050.080.83