Table Question Answering on HiTab (F1)
84.41F1 ScoreQUIETT
Evaluation results
| Method | Links | |
|---|---|---|
| QUIETTCategory=Agentic, Model=Gemini 2.52026.02 | 84.41 | |
| QUIETTCategory=Agentic, Model=DeepSeek V3.12026.02 | 81.3 | |
| QUIETTCategory=Agentic, Model=Qwen 32026.02 | 81.22 | |
| E5Category=Direct, Model=DeepSeek V3.12026.02 | 80.5 | |
| QUIETTCategory=Agentic, Model=GPT-OSS2026.02 | 79.5 | |
| E5Category=Direct, Model=Gemini 2.52026.02 | 78.89 | |
| QUIETTCategory=Agentic, Model=Gemini 2.02026.02 | 77.82 | |
| EEDPCategory=Direct, Model=Gemini 2.52026.02 | 77.6 | |
| E5Category=Direct, Model=GPT-OSS2026.02 | 77.47 | |
| EEDPCategory=Direct, Model=Gemini 2.02026.02 | 76.53 | |
| Chain of TablesCategory=Agentic, Model=Qwen 32026.02 | 76.18 | |
| CoTCategory=Direct, Model=Gemini 2.02026.02 | 76.11 | |
| E5Category=Direct, Model=Gemini 2.02026.02 | 75.83 | |
| Chain of TablesCategory=Agentic, Model=DeepSeek V3.12026.02 | 75.55 | |
| CoTCategory=Direct, Model=Gemini 2.52026.02 | 75.21 | |
| EEDPCategory=Direct, Model=DeepSeek V3.12026.02 | 74.18 | |
| CoTCategory=Direct, Model=Qwen 32026.02 | 72.97 | |
| E5Category=Direct, Model=Qwen 32026.02 | 72.21 | |
| EEDPCategory=Direct, Model=Qwen 32026.02 | 71.27 | |
| CoTCategory=Direct, Model=DeepSeek V3.12026.02 | 71.13 | |
| Chain of TablesCategory=Agentic, Model=Gemini 2.52026.02 | 70.12 | |
| TableSQLifyCategory=Direct, Model=Gemini 2.52026.02 | 69.92 | |
| Chain of TablesCategory=Agentic, Model=Gemini 2.02026.02 | 69.43 | |
| POTCategory=Agentic, Model=Gemini 2.52026.02 | 69.12 | |
| CoT + SQLCategory=Direct, Model=Gemini 2.52026.02 | 69.01 | |
| TableSQLifyCategory=Direct, Model=DeepSeek V3.12026.02 | 67.62 | |
| Chain of TablesCategory=Agentic, Model=GPT-OSS2026.02 | 65.6 | |
| CoT + SQLCategory=Direct, Model=DeepSeek V3.12026.02 | 65.45 | |
| TableSQLifyCategory=Direct, Model=Gemini 2.02026.02 | 64.2 | |
| POTCategory=Agentic, Model=Gemini 2.02026.02 | 64 | |
| TableSQLifyCategory=Direct, Model=Qwen 32026.02 | 62.3 | |
| BinderCategory=Direct, Model=Gemini 2.52026.02 | 59.03 | |
| BinderCategory=Direct, Model=DeepSeek V3.12026.02 | 58.66 | |
| BinderCategory=Direct, Model=GPT-OSS2026.02 | 58.55 | |
| NormTabCategory=Direct, Model=Gemini 2.52026.02 | 56.81 | |
| POTCategory=Agentic, Model=DeepSeek V3.12026.02 | 56.55 | |
| BinderCategory=Direct, Model=Qwen 32026.02 | 56.29 | |
| NormTabCategory=Direct, Model=Gemini 2.02026.02 | 56.24 | |
| CoT + SQLCategory=Direct, Model=Qwen 32026.02 | 56.23 | |
| BinderCategory=Direct, Model=Gemini 2.02026.02 | 55.62 | |
| EEDPCategory=Direct, Model=GPT-OSS2026.02 | 55.48 | |
| NormTabCategory=Direct, Model=GPT-OSS2026.02 | 54.67 | |
| CoTCategory=Direct, Model=GPT-OSS2026.02 | 53.9 | |
| TableSQLifyCategory=Direct, Model=GPT-OSS2026.02 | 53 | |
| CoT + SQLCategory=Direct, Model=Gemini 2.02026.02 | 52.1 | |
| POTCategory=Agentic, Model=GPT-OSS2026.02 | 43.5 | |
| NormTabCategory=Direct, Model=DeepSeek V3.12026.02 | 43.35 | |
| NormTabCategory=Direct, Model=Qwen 32026.02 | 43.3 | |
| POTCategory=Agentic, Model=Qwen 32026.02 | 32.3 | |
| CoT + SQLCategory=Direct, Model=GPT-OSS2026.02 | 31.9 |