List your company
ResearchFormerly WizWand

Table Retrieval on NQ-Tables full (966 queries) (test)

49.84Recall@1CRAFT Stage 3 (large)
17.23625.700534.16542.6295May 21, 2025
Updated 6mo ago

Evaluation results

MethodLinks
CRAFT Stage 3 (large)Stage=3, Embedding model=text-embedding-3-large, Evaluation Set=Full test set (966 queries)2025.0549.8486.8397.17
CRAFTComposition=Final model2025.0549.8486.8397.17
THYMERetrieval Category=Hybrid Retrieval2025.0548.5586.3896.08
DTR (M) + HNRetrieval Category=Dense Retrieval, Checkpoint Source=Original released, Hard Negatives=true2025.0547.3380.9691.51
T-RAGRetrieval Category=Dense Retrieval, Evaluation Set=Full test set (966 queries)2025.0546.0785.495.03
BIBERT+SPLADERetrieval Category=Hybrid Retrieval2025.0545.6286.7295.62
SSDR(im)Retrieval Category=Dense Retrieval2025.0545.478495.05
DPRRetrieval Category=Dense Retrieval2025.0545.3285.8495.44
TAPASRetrieval Category=Dense Retrieval2025.0543.7983.4995.1
BIBERTRetrieval Category=Dense Retrieval2025.0543.7882.2593.71
DHRRetrieval Category=Hybrid Retrieval2025.0543.6784.6595.62
DTR (S) + HNRetrieval Category=Dense Retrieval, Checkpoint Source=Original released, Hard Negatives=true2025.0543.5377.890.21
CRAFT Stage 3 (small)Stage=3, Embedding model=text-embedding-3-small, Evaluation Set=Full test set (966 queries)2025.0541.1387.1696.84
SPLADERetrieval Category=Sparse Retrieval2025.0539.8483.3394.65
CRAFT Stage 2Stage=2, Composition=Stage 1 + Stage 22025.0536.6582.9196.08
BIBERT+BM25Retrieval Category=Hybrid Retrieval2025.0535.8779.6394.56
CRAFT Stage 1Stage=12025.0534.3872.991.62
DTRRetrieval Category=Dense Retrieval, Training Setup=THYME setup2025.0532.6275.8689.77
Re2GRetrieval Category=Hybrid Retrieval, Checkpoint Source=Original released2025.0530.4766.4983.35
BM25Retrieval Category=Sparse Retrieval2025.0518.4936.9452.61