Table Question Answering on NQTables (test)
72.5F1 ScoreReasonBERTT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ReasonBERTTBackbone=TAPAS2021.09 | 72.5 | 67.3 | |
| CRAFTn=5, LLM=GPT-4o2025.05 | 67.72 | — | |
| ReasonBERTRBackbone=RoBERTa2021.09 | 66.3 | 60.9 | |
| TAPASBackbone=TAPAS2021.09 | 65.9 | 59.6 | |
| RoBERTaBackbone=RoBERTa2021.09 | 63.6 | 58.1 | |
| CRAFTn=5, LLM=Mistral-Small-Instruct2025.05 | 57.14 | — | |
| CRAFTn=5, LLM=Llama-3.1-70B-Instruct2025.05 | 56.94 | — | |
| CRAFTn=1, LLM=GPT-4o2025.05 | 56.76 | — | |
| CRAFTn=5, LLM=Llama-3.3-70B-Instruct2025.05 | 55.16 | — | |
| LI-RAGEn=52025.05 | 54.17 | — | |
| CRAFTn=1, LLM=Mistral-Small-Instruct2025.05 | 50.26 | — | |
| CRAFTn=1, LLM=Llama-3.1-70B-Instruct2025.05 | 49.75 | — | |
| DPR-RAGEn=52025.05 | 49.68 | — | |
| CRAFTn=5, LLM=Qwen2.5-72B-Instruct2025.05 | 49.17 | — | |
| CRAFTn=1, LLM=Qwen2.5-72B-Instruct2025.05 | 48.75 | — | |
| CRAFTn=5, LLM=Qwen2.5-7B-Instruct2025.05 | 46.49 | — | |
| CRAFTn=1, LLM=Llama-3.3-70B-Instruct2025.05 | 46.21 | — | |
| CRAFTn=3, LLM=Mistral-7B-Instruct2025.05 | 45.28 | — | |
| CRAFTn=5, LLM=Mistral-7B-Instruct2025.05 | 44.53 | — | |
| CRAFTn=3, LLM=Qwen2.5-7B-Instruct2025.05 | 43.52 | — | |
| THYMEn=5, LLM=Qwen2.5-7B-Instruct2025.05 | 41.2 | — | |
| CRAFTn=3, LLM=Llama3-8B-Instruct2025.05 | 40.76 | — | |
| CRAFTn=5, LLM=Llama3-8B-Instruct2025.05 | 40.55 | — | |
| THYMEn=3, LLM=Qwen2.5-7B-Instruct2025.05 | 40.28 | — | |
| CRAFTn=1, LLM=Qwen2.5-7B-Instruct2025.05 | 39.73 | — | |
| RAGn=52025.05 | 39.67 | — | |
| THYMEn=5, LLM=Llama3-8B-Instruct2025.05 | 39.29 | — | |
| THYMEn=3, LLM=Llama3-8B-Instruct2025.05 | 39.16 | — | |
| CRAFTn=1, LLM=Mistral-7B-Instruct2025.05 | 39.13 | — | |
| CRAFTn=1, LLM=Llama3-8B-Instruct2025.05 | 38.31 | — | |
| SSDR_inn=3, LLM=Llama3-8B-Instruct2025.05 | 38.14 | — | |
| BIBERTn=3, LLM=Qwen2.5-7B-Instruct2025.05 | 37.92 | — | |
| SSDR_inn=5, LLM=Llama3-8B-Instruct2025.05 | 37.89 | — | |
| THYMEn=3, LLM=Mistral-7B-Instruct2025.05 | 37.59 | — | |
| SPLADEn=5, LLM=Qwen2.5-7B-Instruct2025.05 | 37.35 | — | |
| THYMEn=1, LLM=Qwen2.5-7B-Instruct2025.05 | 37.28 | — | |
| THYMEn=5, LLM=Mistral-7B-Instruct2025.05 | 37.2 | — | |
| SPLADEn=3, LLM=Llama3-8B-Instruct2025.05 | 37.17 | — | |
| SSDR_inn=3, LLM=Qwen2.5-7B-Instruct2025.05 | 37.14 | — | |
| BIBERT-SPLADEn=5, LLM=Qwen2.5-7B-Instruct2025.05 | 37.02 | — | |
| BIBERTn=5, LLM=Qwen2.5-7B-Instruct2025.05 | 37.01 | — | |
| SSDR_inn=3, LLM=Mistral-7B-Instruct2025.05 | 36.95 | — | |
| BIBERT-SPLADEn=3, LLM=Qwen2.5-7B-Instruct2025.05 | 36.76 | — | |
| SSDR_inn=5, LLM=Mistral-7B-Instruct2025.05 | 36.6 | — | |
| THYMEn=1, LLM=Llama3-8B-Instruct2025.05 | 36.14 | — | |
| SPLADEn=3, LLM=Qwen2.5-7B-Instruct2025.05 | 35.79 | — | |
| BIBERT-SPLADEn=5, LLM=Mistral-7B-Instruct2025.05 | 35.71 | — | |
| THYMEn=1, LLM=Mistral-7B-Instruct2025.05 | 35.48 | — | |
| SPLADEn=3, LLM=Mistral-7B-Instruct2025.05 | 35.42 | — | |
| BIBERTn=5, LLM=Mistral-7B-Instruct2025.05 | 35.3 | — | |
| SPLADEn=5, LLM=Mistral-7B-Instruct2025.05 | 34.95 | — | |
| BIBERTn=1, LLM=Qwen2.5-7B-Instruct2025.05 | 34.8 | — | |
| BIBERTn=3, LLM=Mistral-7B-Instruct2025.05 | 34.6 | — | |
| BIBERTn=5, LLM=Llama3-8B-Instruct2025.05 | 34.28 | — | |
| SSDR_inn=1, LLM=Llama3-8B-Instruct2025.05 | 34.25 | — | |
| SSDR_inn=5, LLM=Qwen2.5-7B-Instruct2025.05 | 33.92 | — | |
| BIBERT-SPLADEn=5, LLM=Llama3-8B-Instruct2025.05 | 33.92 | — | |
| SPLADEn=5, LLM=Llama3-8B-Instruct2025.05 | 33.88 | — | |
| BIBERT-SPLADEn=3, LLM=Llama3-8B-Instruct2025.05 | 33.66 | — | |
| BIBERT-SPLADEn=3, LLM=Mistral-7B-Instruct2025.05 | 33.59 | — | |
| SSDR_inn=1, LLM=Qwen2.5-7B-Instruct2025.05 | 33.42 | — | |
| BIBERT-SPLADEn=1, LLM=Qwen2.5-7B-Instruct2025.05 | 33.24 | — | |
| BIBERTn=3, LLM=Llama3-8B-Instruct2025.05 | 33.16 | — | |
| BIBERTn=1, LLM=Mistral-7B-Instruct2025.05 | 32.93 | — | |
| SSDR_inn=1, LLM=Mistral-7B-Instruct2025.05 | 32.76 | — | |
| BIBERT-SPLADEn=1, LLM=Mistral-7B-Instruct2025.05 | 32.67 | — | |
| BIBERTn=1, LLM=Llama3-8B-Instruct2025.05 | 32.66 | — | |
| BIBERT-SPLADEn=1, LLM=Llama3-8B-Instruct2025.05 | 32.66 | — | |
| SPLADEn=1, LLM=Llama3-8B-Instruct2025.05 | 32.07 | — | |
| SPLADEn=1, LLM=Qwen2.5-7B-Instruct2025.05 | 31.9 | — | |
| SPLADEn=1, LLM=Mistral-7B-Instruct2025.05 | 29.61 | — |