Table Reasoning on HiTab (Pass@1)
70.1Pass@1TAC
Evaluation results
| Method | Links | |
|---|---|---|
| TACBackbone=Qwen3-4B-Base, Seeds=12026.06 | 70.1 | |
| SECBackbone=Qwen3-4B-Base, Seeds=12026.06 | 65.4 | |
| RandomBackbone=Qwen3-4B-Base, Seeds=12026.06 | 61.4 | |
| TACBackbone=Llama3.2-3B2026.06 | 61.3 | |
| RandomBackbone=Llama3.2-3B2026.06 | 60.5 | |
| M2OBackbone=Llama3.2-3B2026.06 | 60 | |
| TACBackbone=Qwen3-1.7B2026.06 | 56.5 | |
| SECBackbone=Llama3.2-3B2026.06 | 56.5 | |
| RandomBackbone=Qwen3-1.7B2026.06 | 54.5 | |
| SECBackbone=Qwen3-1.7B2026.06 | 53.4 | |
| M2OBackbone=Qwen3-1.7B2026.06 | 51.5 | |
| TACBackbone=Qwen3-0.6B-Base, Seeds=12026.06 | 41.5 | |
| SECBackbone=Qwen3-0.6B-Base, Seeds=12026.06 | 37.9 | |
| RandomBackbone=Qwen3-0.6B-Base, Seeds=12026.06 | 36.5 | |
| BaseBackbone=Llama3.2-3B2026.06 | 16.6 | |
| BaseBackbone=Qwen3-1.7B2026.06 | 13.7 |