List your company
ResearchFormerly WizWand

Table Question Answering on NQ-Table

80.1F1 ScoreQUIETT
32.374444.764757.15569.5453May 21, 2025Jul 6, 2025Aug 21, 2025Oct 7, 2025Nov 22, 2025Jan 7, 2026Feb 23, 2026
Updated 6mo ago

Evaluation results

MethodLinks
QUIETTCategory=Agentic, Model=Gemini 2.52026.0280.1
QUIETTCategory=Agentic, Model=DeepSeek V3.12026.0279.2
QUIETTCategory=Agentic, Model=Gemini 2.02026.0273.25
EEDPCategory=Direct, Model=Gemini 2.52026.0272.79
QUIETTCategory=Agentic, Model=GPT-OSS2026.0272.75
QUIETTCategory=Agentic, Model=Qwen 32026.0272.6
EEDPCategory=Direct, Model=DeepSeek V3.12026.0272.29
EEDPCategory=Direct, Model=GPT-OSS2026.0271.8
CoTCategory=Direct, Model=Gemini 2.52026.0271.22
EEDPCategory=Direct, Model=Gemini 2.02026.0270.31
Chain of TablesCategory=Agentic, Model=DeepSeek V3.12026.0270.1
Chain of TablesCategory=Agentic, Model=Gemini 2.52026.0269.56
CoTCategory=Direct, Model=Gemini 2.02026.0268.7
CRAFTLLM Backbone=GPT-4o, n=52025.0567.72
POTCategory=Agentic, Model=Gemini 2.52026.0267.7
BinderCategory=Direct, Model=DeepSeek V3.12026.0267.44
BinderCategory=Direct, Model=Gemini 2.52026.0267.24
CoTCategory=Direct, Model=GPT-OSS2026.0266.6
BinderCategory=Direct, Model=GPT-OSS2026.0266.5
POTCategory=Agentic, Model=DeepSeek V3.12026.0265.33
Chain of TablesCategory=Agentic, Model=Qwen 32026.0264.33
CoTCategory=Direct, Model=DeepSeek V3.12026.0263.6
Chain of TablesCategory=Agentic, Model=Gemini 2.02026.0262.3
BinderCategory=Direct, Model=Gemini 2.02026.0262.25
EEDPCategory=Direct, Model=Qwen 32026.0262.21
POTCategory=Agentic, Model=Qwen 32026.0262.1
POTCategory=Agentic, Model=Gemini 2.02026.0261.7
BinderCategory=Direct, Model=Qwen 32026.0261.56
CoTCategory=Direct, Model=Qwen 32026.0261.34
Chain of TablesCategory=Agentic, Model=GPT-OSS2026.0260.21
POTCategory=Agentic, Model=GPT-OSS2026.0257.6
CRAFTLLM Backbone=Mistral-Small-Instruct, n=52025.0557.14
TableSQLifyCategory=Direct, Model=DeepSeek V3.12026.0256.94
CRAFTLLM Backbone=Llama-3.1-70B-Instruct, n=52025.0556.94
CRAFTLLM Backbone=GPT-4o, n=12025.0556.76
E5Category=Direct, Model=Gemini 2.52026.0255.9
NormTabCategory=Direct, Model=DeepSeek V3.12026.0255.4
CRAFTLLM Backbone=Llama-3.3-70B-Instruct, n=52025.0555.16
E5Category=Direct, Model=DeepSeek V3.12026.0254.55
LI-RAGEn=52025.0554.17
E5Category=Direct, Model=GPT-OSS2026.0254
E5Category=Direct, Model=Qwen 32026.0253.16
NormTabCategory=Direct, Model=Gemini 2.52026.0253
NormTabCategory=Direct, Model=Gemini 2.02026.0251.8
TableSQLifyCategory=Direct, Model=Qwen 32026.0251.34
NormTabCategory=Direct, Model=GPT-OSS2026.0250.3
CRAFTLLM Backbone=Mistral-Small-Instruct, n=12025.0550.26
CRAFTLLM Backbone=Llama-3.1-70B-Instruct, n=12025.0549.75
DPR-RAGEn=52025.0549.68
CRAFTLLM Backbone=Qwen2.5-72B-Instruct, n=52025.0549.17
CRAFTLLM Backbone=Qwen2.5-72B-Instruct, n=12025.0548.75
E5Category=Direct, Model=Gemini 2.02026.0248.4
CoT + SQLCategory=Direct, Model=GPT-OSS2026.0247.9
TableSQLifyCategory=Direct, Model=Gemini 2.02026.0247.51
TableSQLifyCategory=Direct, Model=GPT-OSS2026.0246.99
NormTabCategory=Direct, Model=Qwen 32026.0246.8
CRAFTLLM Backbone=Llama-3.3-70B-Instruct, n=12025.0546.21
CoT + SQLCategory=Direct, Model=Gemini 2.02026.0243.29
RAGn=52025.0539.67
CoT + SQLCategory=Direct, Model=Gemini 2.52026.0236.64
TableSQLifyCategory=Direct, Model=Gemini 2.52026.0234.78
CoT + SQLCategory=Direct, Model=Qwen 32026.0234.54
CoT + SQLCategory=Direct, Model=DeepSeek V3.12026.0234.21