List your company
ResearchFormerly WizWand

Table Question Answering on NQTables (test)

72.5F1 ScoreReasonBERTT
27.894439.474751.05562.6353Sep 10, 2021Apr 22, 2022Dec 3, 2022Jul 16, 2023Feb 26, 2024Oct 8, 2024May 21, 2025
Updated 6mo ago

Evaluation results

MethodLinks
ReasonBERTTBackbone=TAPAS2021.0972.567.3
CRAFTn=5, LLM=GPT-4o2025.0567.72—
ReasonBERTRBackbone=RoBERTa2021.0966.360.9
TAPASBackbone=TAPAS2021.0965.959.6
RoBERTaBackbone=RoBERTa2021.0963.658.1
CRAFTn=5, LLM=Mistral-Small-Instruct2025.0557.14—
CRAFTn=5, LLM=Llama-3.1-70B-Instruct2025.0556.94—
CRAFTn=1, LLM=GPT-4o2025.0556.76—
CRAFTn=5, LLM=Llama-3.3-70B-Instruct2025.0555.16—
LI-RAGEn=52025.0554.17—
CRAFTn=1, LLM=Mistral-Small-Instruct2025.0550.26—
CRAFTn=1, LLM=Llama-3.1-70B-Instruct2025.0549.75—
DPR-RAGEn=52025.0549.68—
CRAFTn=5, LLM=Qwen2.5-72B-Instruct2025.0549.17—
CRAFTn=1, LLM=Qwen2.5-72B-Instruct2025.0548.75—
CRAFTn=5, LLM=Qwen2.5-7B-Instruct2025.0546.49—
CRAFTn=1, LLM=Llama-3.3-70B-Instruct2025.0546.21—
CRAFTn=3, LLM=Mistral-7B-Instruct2025.0545.28—
CRAFTn=5, LLM=Mistral-7B-Instruct2025.0544.53—
CRAFTn=3, LLM=Qwen2.5-7B-Instruct2025.0543.52—
THYMEn=5, LLM=Qwen2.5-7B-Instruct2025.0541.2—
CRAFTn=3, LLM=Llama3-8B-Instruct2025.0540.76—
CRAFTn=5, LLM=Llama3-8B-Instruct2025.0540.55—
THYMEn=3, LLM=Qwen2.5-7B-Instruct2025.0540.28—
CRAFTn=1, LLM=Qwen2.5-7B-Instruct2025.0539.73—
RAGn=52025.0539.67—
THYMEn=5, LLM=Llama3-8B-Instruct2025.0539.29—
THYMEn=3, LLM=Llama3-8B-Instruct2025.0539.16—
CRAFTn=1, LLM=Mistral-7B-Instruct2025.0539.13—
CRAFTn=1, LLM=Llama3-8B-Instruct2025.0538.31—
SSDR_inn=3, LLM=Llama3-8B-Instruct2025.0538.14—
BIBERTn=3, LLM=Qwen2.5-7B-Instruct2025.0537.92—
SSDR_inn=5, LLM=Llama3-8B-Instruct2025.0537.89—
THYMEn=3, LLM=Mistral-7B-Instruct2025.0537.59—
SPLADEn=5, LLM=Qwen2.5-7B-Instruct2025.0537.35—
THYMEn=1, LLM=Qwen2.5-7B-Instruct2025.0537.28—
THYMEn=5, LLM=Mistral-7B-Instruct2025.0537.2—
SPLADEn=3, LLM=Llama3-8B-Instruct2025.0537.17—
SSDR_inn=3, LLM=Qwen2.5-7B-Instruct2025.0537.14—
BIBERT-SPLADEn=5, LLM=Qwen2.5-7B-Instruct2025.0537.02—
BIBERTn=5, LLM=Qwen2.5-7B-Instruct2025.0537.01—
SSDR_inn=3, LLM=Mistral-7B-Instruct2025.0536.95—
BIBERT-SPLADEn=3, LLM=Qwen2.5-7B-Instruct2025.0536.76—
SSDR_inn=5, LLM=Mistral-7B-Instruct2025.0536.6—
THYMEn=1, LLM=Llama3-8B-Instruct2025.0536.14—
SPLADEn=3, LLM=Qwen2.5-7B-Instruct2025.0535.79—
BIBERT-SPLADEn=5, LLM=Mistral-7B-Instruct2025.0535.71—
THYMEn=1, LLM=Mistral-7B-Instruct2025.0535.48—
SPLADEn=3, LLM=Mistral-7B-Instruct2025.0535.42—
BIBERTn=5, LLM=Mistral-7B-Instruct2025.0535.3—
SPLADEn=5, LLM=Mistral-7B-Instruct2025.0534.95—
BIBERTn=1, LLM=Qwen2.5-7B-Instruct2025.0534.8—
BIBERTn=3, LLM=Mistral-7B-Instruct2025.0534.6—
BIBERTn=5, LLM=Llama3-8B-Instruct2025.0534.28—
SSDR_inn=1, LLM=Llama3-8B-Instruct2025.0534.25—
SSDR_inn=5, LLM=Qwen2.5-7B-Instruct2025.0533.92—
BIBERT-SPLADEn=5, LLM=Llama3-8B-Instruct2025.0533.92—
SPLADEn=5, LLM=Llama3-8B-Instruct2025.0533.88—
BIBERT-SPLADEn=3, LLM=Llama3-8B-Instruct2025.0533.66—
BIBERT-SPLADEn=3, LLM=Mistral-7B-Instruct2025.0533.59—
SSDR_inn=1, LLM=Qwen2.5-7B-Instruct2025.0533.42—
BIBERT-SPLADEn=1, LLM=Qwen2.5-7B-Instruct2025.0533.24—
BIBERTn=3, LLM=Llama3-8B-Instruct2025.0533.16—
BIBERTn=1, LLM=Mistral-7B-Instruct2025.0532.93—
SSDR_inn=1, LLM=Mistral-7B-Instruct2025.0532.76—
BIBERT-SPLADEn=1, LLM=Mistral-7B-Instruct2025.0532.67—
BIBERTn=1, LLM=Llama3-8B-Instruct2025.0532.66—
BIBERT-SPLADEn=1, LLM=Llama3-8B-Instruct2025.0532.66—
SPLADEn=1, LLM=Llama3-8B-Instruct2025.0532.07—
SPLADEn=1, LLM=Qwen2.5-7B-Instruct2025.0531.9—
SPLADEn=1, LLM=Mistral-7B-Instruct2025.0529.61—