Table Question Answering on Penguins in a Table
96.5EMSynTQA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SynTQABackbone=Claude-3.7-Sonnet, Category=Large LLM2026.02 | 96.5 | 97 | 96.5 | |
| MATABackbone=qwen2.5-7b, Category=Small LLM2026.02 | 95.1 | 95.5 | 95.1 | |
| SynTQABackbone=GPT-4o, Category=Large LLM2026.02 | 95.1 | 96.1 | 95.1 | |
| MATABackbone=Claude-3.7-Sonnet, Category=Large LLM2026.02 | 95.1 | 95.1 | 95.1 | |
| TabLaPBackbone=cogito-32b, Category=Large LLM2026.02 | 93.1 | 93.4 | 93.1 | |
| MixSCBackbone=Claude-3.7-Sonnet, Category=Large LLM2026.02 | 92.4 | 92.4 | 92.4 | |
| MATABackbone=qwen2.5-32b, Category=Large LLM2026.02 | 91.7 | 91.7 | 91.7 | |
| MixSCBackbone=cogito-32b, Category=Large LLM2026.02 | 90.3 | 90.8 | 90.3 | |
| MATABackbone=cogito-32b, Category=Large LLM2026.02 | 90.3 | 90.3 | 90.3 | |
| MATABackbone=GPT-4o, Category=Large LLM2026.02 | 90.3 | 90.3 | 90.3 | |
| SynTQABackbone=mistral-small-24b, Category=Large LLM2026.02 | 89.6 | 91.8 | 89.6 | |
| MATABackbone=mistral-small-24b, Category=Large LLM2026.02 | 89.6 | 89.6 | 89.6 | |
| MATABackbone=qwen2.5-3b, Category=Small LLM2026.02 | 86.8 | 88.3 | 86.8 | |
| SynTQABackbone=cogito-32b, Category=Large LLM2026.02 | 86.8 | 88.6 | 86.8 | |
| TabLaPBackbone=Claude-3.7-Sonnet, Category=Large LLM2026.02 | 86.8 | 86.8 | 86.8 | |
| MATABackbone=mistral-7b, Category=Small LLM2026.02 | 86.1 | 88 | 86.1 | |
| SynTQABackbone=qwen2.5-32b, Category=Large LLM2026.02 | 86.1 | 89.2 | 86.1 | |
| MixSCBackbone=GPT-4o, Category=Large LLM2026.02 | 83.3 | 83.5 | 83.3 | |
| MATABackbone=phi4-mini-3.8b, Category=Small LLM2026.02 | 81.9 | 84.7 | 81.9 | |
| SynTQABackbone=phi4-mini-3.8b, Category=Small LLM2026.02 | 81.3 | 82.7 | 81.3 | |
| SynTQABackbone=qwen2.5-7b, Category=Small LLM2026.02 | 81.3 | 86.6 | 81.5 | |
| MixSCBackbone=mistral-small-24b, Category=Large LLM2026.02 | 80.6 | 81.3 | 81 | |
| MixSCBackbone=qwen2.5-32b, Category=Large LLM2026.02 | 78.5 | 80.2 | 78.9 | |
| TabLaPBackbone=mistral-small-24b, Category=Large LLM2026.02 | 76.4 | 78.4 | 77.3 | |
| MATABackbone=llama3.2-3b, Category=Small LLM2026.02 | 73.6 | 76.6 | 73.6 | |
| SynTQABackbone=qwen2.5-3b, Category=Small LLM2026.02 | 69.4 | 73.7 | 69.4 | |
| TabLaPBackbone=GPT-4o, Category=Large LLM2026.02 | 65.3 | 65.5 | 65.3 | |
| SynTQABackbone=mistral-7b, Category=Small LLM2026.02 | 63.9 | 68 | 64.5 | |
| TabLaPBackbone=qwen2.5-32b, Category=Large LLM2026.02 | 61.1 | 68.7 | 65.6 | |
| SynTQABackbone=llama3.2-3b, Category=Small LLM2026.02 | 59.7 | 65.4 | 60.2 | |
| MixSCBackbone=qwen2.5-7b, Category=Small LLM2026.02 | 59.7 | 65.7 | 59.7 | |
| MixSCBackbone=phi4-mini-3.8b, Category=Small LLM2026.02 | 50 | 59.3 | 52.8 | |
| TabLaPBackbone=qwen2.5-7b, Category=Small LLM2026.02 | 44.4 | 52.2 | 44.4 | |
| MixSCBackbone=qwen2.5-3b, Category=Small LLM2026.02 | 43.8 | 51.7 | 44.2 | |
| TabLaPBackbone=qwen2.5-3b, Category=Small LLM2026.02 | 39.6 | 47.9 | 40 | |
| TabLaPBackbone=phi4-mini-3.8b, Category=Small LLM2026.02 | 33.3 | 48.3 | 36.2 | |
| MixSCBackbone=mistral-7b, Category=Small LLM2026.02 | 27.1 | 38.5 | 28.9 | |
| MixSCBackbone=llama3.2-3b, Category=Small LLM2026.02 | 20.1 | 30.3 | 25.2 | |
| TabLaPBackbone=llama3.2-3b, Category=Small LLM2026.02 | 18.8 | 29 | 24.7 | |
| TabLaPBackbone=mistral-7b, Category=Small LLM2026.02 | 4.9 | 23.1 | 10.2 |