Table Retrieval on NQ-Tables full (966 queries) (test)
49.84Recall@1CRAFT Stage 3 (large)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CRAFT Stage 3 (large)Stage=3, Embedding model=text-embedding-3-large, Evaluation Set=Full test set (966 queries)2025.05 | 49.84 | 86.83 | 97.17 | |
| CRAFTComposition=Final model2025.05 | 49.84 | 86.83 | 97.17 | |
| THYMERetrieval Category=Hybrid Retrieval2025.05 | 48.55 | 86.38 | 96.08 | |
| DTR (M) + HNRetrieval Category=Dense Retrieval, Checkpoint Source=Original released, Hard Negatives=true2025.05 | 47.33 | 80.96 | 91.51 | |
| T-RAGRetrieval Category=Dense Retrieval, Evaluation Set=Full test set (966 queries)2025.05 | 46.07 | 85.4 | 95.03 | |
| BIBERT+SPLADERetrieval Category=Hybrid Retrieval2025.05 | 45.62 | 86.72 | 95.62 | |
| SSDR(im)Retrieval Category=Dense Retrieval2025.05 | 45.47 | 84 | 95.05 | |
| DPRRetrieval Category=Dense Retrieval2025.05 | 45.32 | 85.84 | 95.44 | |
| TAPASRetrieval Category=Dense Retrieval2025.05 | 43.79 | 83.49 | 95.1 | |
| BIBERTRetrieval Category=Dense Retrieval2025.05 | 43.78 | 82.25 | 93.71 | |
| DHRRetrieval Category=Hybrid Retrieval2025.05 | 43.67 | 84.65 | 95.62 | |
| DTR (S) + HNRetrieval Category=Dense Retrieval, Checkpoint Source=Original released, Hard Negatives=true2025.05 | 43.53 | 77.8 | 90.21 | |
| CRAFT Stage 3 (small)Stage=3, Embedding model=text-embedding-3-small, Evaluation Set=Full test set (966 queries)2025.05 | 41.13 | 87.16 | 96.84 | |
| SPLADERetrieval Category=Sparse Retrieval2025.05 | 39.84 | 83.33 | 94.65 | |
| CRAFT Stage 2Stage=2, Composition=Stage 1 + Stage 22025.05 | 36.65 | 82.91 | 96.08 | |
| BIBERT+BM25Retrieval Category=Hybrid Retrieval2025.05 | 35.87 | 79.63 | 94.56 | |
| CRAFT Stage 1Stage=12025.05 | 34.38 | 72.9 | 91.62 | |
| DTRRetrieval Category=Dense Retrieval, Training Setup=THYME setup2025.05 | 32.62 | 75.86 | 89.77 | |
| Re2GRetrieval Category=Hybrid Retrieval, Checkpoint Source=Original released2025.05 | 30.47 | 66.49 | 83.35 | |
| BM25Retrieval Category=Sparse Retrieval2025.05 | 18.49 | 36.94 | 52.61 |