Table Retrieval on OTT-QA (test)
96.7Recall@10Sparse Lexical Repr. (BM25)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Sparse Lexical Repr. (BM25)include_table_title=true2026.05 | 96.7 | — | — | |
| Sparse Lexical Repr. (TF-IDF)include_table_title=true2026.05 | 96.3 | — | — | |
| Dense Table Embeddingrepresentation=full table2026.05 | 96.3 | — | — | |
| Dense Row-level Embedding2026.05 | 95.1 | — | — | |
| pT + QGpT2026.05 | 91.5 | — | — | |
| THYMERetrieval Model Category=Hybrid Retrieval Models2025.05 | 91.1 | 66.67 | 96.16 | |
| BIBERT+SPLADERetrieval Model Category=Hybrid Retrieval Models2025.05 | 91.01 | 64.72 | 96.34 | |
| CRAFT Stage 3Retrieval Model Category=CRAFT Stage-wise, Stage=Stage 1 + Stage 2 + Stage 32025.05 | 89.88 | 55.56 | 96.07 | |
| CRAFTRetrieval Model Category=CRAFT Stage-wise, Final=true2025.05 | 89.88 | 55.56 | 96.07 | |
| SPLADERetrieval Model Category=Sparse Retrieval Models, Supervised=true2025.05 | 89.52 | 62.74 | 95.21 | |
| DHRRetrieval Model Category=Hybrid Retrieval Models2025.05 | 88.48 | 63.64 | 95.3 | |
| BIBERT+BM25Retrieval Model Category=Hybrid Retrieval Models2025.05 | 86.81 | 59.49 | 94.67 | |
| TAPASRetrieval Model Category=Dense Retrieval Models2025.05 | 86.77 | 57.86 | 94.04 | |
| pT2026.05 | 86.7 | — | — | |
| BIBERTRetrieval Model Category=Dense Retrieval Models2025.05 | 86.5 | 56.82 | 94.26 | |
| SSDR(im)Retrieval Model Category=Dense Retrieval Models2025.05 | 86.22 | 56.96 | 93.55 | |
| DPRRetrieval Model Category=Dense Retrieval Models2025.05 | 85.95 | 53.43 | 93.22 | |
| Dense Metadata Embedding2026.05 | 82 | — | — | |
| CRAFT Stage 2Retrieval Model Category=CRAFT Stage-wise, Stage=Stage 1 + Stage 22025.05 | 81.88 | 47.33 | 91.82 | |
| PIPERquery optimization=false2026.05 | 78 | — | — | |
| DTRRetrieval Model Category=Dense Retrieval Models2025.05 | 75.75 | 42.1 | 88.8 | |
| PIPERquery optimization=true2026.05 | 72.9 | — | — | |
| Dense Table Embeddingrepresentation=column names only2026.05 | 65.8 | — | — | |
| CRAFT Stage 1Retrieval Model Category=CRAFT Stage-wise, Stage=Stage 12025.05 | 60.89 | 40.74 | 88.17 | |
| Sparse Lexical Repr. (BM25)include_table_title=false2026.05 | 59.2 | — | — | |
| Sparse Lexical Repr. (TF-IDF)include_table_title=false2026.05 | 58.3 | — | — | |
| BM25Retrieval Model Category=Sparse Retrieval Models2025.05 | 51.94 | 23.98 | 69.11 |