Table Question Answering on SequentialQA
73F1 ScoreQUIETT
Evaluation results
| Method | Links | |
|---|---|---|
| QUIETTCategory=Agentic, Model=GPT-OSS2026.02 | 73 | |
| QUIETTCategory=Agentic, Model=Gemini 2.52026.02 | 72.32 | |
| QUIETTCategory=Agentic, Model=Gemini 2.02026.02 | 70.11 | |
| QUIETTCategory=Agentic, Model=DeepSeek V3.12026.02 | 66.15 | |
| POTCategory=Agentic, Model=Gemini 2.52026.02 | 63.52 | |
| QUIETTCategory=Agentic, Model=Qwen 32026.02 | 62.54 | |
| CoTCategory=Direct, Model=Gemini 2.02026.02 | 62.33 | |
| CoTCategory=Direct, Model=Gemini 2.52026.02 | 61.98 | |
| EEDPCategory=Direct, Model=Gemini 2.02026.02 | 61.1 | |
| EEDPCategory=Direct, Model=Gemini 2.52026.02 | 60.3 | |
| CoTCategory=Direct, Model=GPT-OSS2026.02 | 60.26 | |
| EEDPCategory=Direct, Model=DeepSeek V3.12026.02 | 60.25 | |
| POTCategory=Agentic, Model=DeepSeek V3.12026.02 | 59.79 | |
| CoT + SQLCategory=Direct, Model=Qwen 32026.02 | 59.64 | |
| CoTCategory=Direct, Model=DeepSeek V3.12026.02 | 59.5 | |
| POTCategory=Agentic, Model=Qwen 32026.02 | 59.28 | |
| CoT + SQLCategory=Direct, Model=Gemini 2.52026.02 | 58.23 | |
| CoTCategory=Direct, Model=Qwen 32026.02 | 57.12 | |
| CoT + SQLCategory=Direct, Model=DeepSeek V3.12026.02 | 56.3 | |
| POTCategory=Agentic, Model=Gemini 2.02026.02 | 56.1 | |
| EEDPCategory=Direct, Model=Qwen 32026.02 | 55.9 | |
| CoT + SQLCategory=Direct, Model=GPT-OSS2026.02 | 55.2 | |
| EEDPCategory=Direct, Model=GPT-OSS2026.02 | 54.9 | |
| CoT + SQLCategory=Direct, Model=Gemini 2.02026.02 | 50.06 | |
| NormTabCategory=Direct, Model=Gemini 2.52026.02 | 50 | |
| NormTabCategory=Direct, Model=Qwen 32026.02 | 48.68 | |
| NormTabCategory=Direct, Model=GPT-OSS2026.02 | 48.6 | |
| NormTabCategory=Direct, Model=Gemini 2.02026.02 | 47.95 | |
| NormTabCategory=Direct, Model=DeepSeek V3.12026.02 | 45.57 | |
| Chain of TablesCategory=Agentic, Model=DeepSeek V3.12026.02 | 44.53 | |
| POTCategory=Agentic, Model=GPT-OSS2026.02 | 44.5 | |
| Chain of TablesCategory=Agentic, Model=Qwen 32026.02 | 44.28 | |
| E5Category=Direct, Model=GPT-OSS2026.02 | 43.8 | |
| E5Category=Direct, Model=Gemini 2.02026.02 | 42.75 | |
| E5Category=Direct, Model=DeepSeek V3.12026.02 | 42.75 | |
| E5Category=Direct, Model=Qwen 32026.02 | 42.69 | |
| Chain of TablesCategory=Agentic, Model=Gemini 2.02026.02 | 41.24 | |
| E5Category=Direct, Model=Gemini 2.52026.02 | 31.64 | |
| TableSQLifyCategory=Direct, Model=DeepSeek V3.12026.02 | 30.01 | |
| TableSQLifyCategory=Direct, Model=Qwen 32026.02 | 29.18 | |
| TableSQLifyCategory=Direct, Model=Gemini 2.52026.02 | 26.78 | |
| TableSQLifyCategory=Direct, Model=GPT-OSS2026.02 | 26.73 | |
| Chain of TablesCategory=Agentic, Model=GPT-OSS2026.02 | 23.2 | |
| BinderCategory=Direct, Model=Gemini 2.52026.02 | 22.49 | |
| Chain of TablesCategory=Agentic, Model=Gemini 2.52026.02 | 22.27 | |
| BinderCategory=Direct, Model=Gemini 2.02026.02 | 21.82 | |
| BinderCategory=Direct, Model=GPT-OSS2026.02 | 21.5 | |
| BinderCategory=Direct, Model=Qwen 32026.02 | 20.54 | |
| BinderCategory=Direct, Model=DeepSeek V3.12026.02 | 20.19 | |
| TableSQLifyCategory=Direct, Model=Gemini 2.02026.02 | 10.71 |