Question Answering on TabMCQ OOD (test)
51.51AccuracyTable-LLaVA 13B
Evaluation results
| Method | Links | |
|---|---|---|
| Table-LLaVA 13BReasoning Strategy=SFT, # TIR=82K2026.02 | 51.51 | |
| Table-LLaVA 7BReasoning Strategy=SFT, # TIR=82K2026.02 | 44.51 | |
| MiniCPM-V-2.6 8BReasoning Strategy=HIPPO, # TIR=55.2K2026.02 | 40.04 | |
| Qwen3-VL-8B-DISCOReasoning Strategy=Table-GLS, # TIR=02026.02 | 38 | |
| Qwen3-VL-8B-DISCOReasoning Strategy=DA, # TIR=02026.02 | 37.8 | |
| Qwen3-VL-8BReasoning Strategy=DA, # TIR=02026.02 | 37.71 | |
| GPT-4o-miniReasoning Strategy=DA, # TIR=02026.02 | 36.35 | |
| Gemma3n-E4BReasoning Strategy=DA, # TIR=02026.02 | 34.5 | |
| Gemma3n-E4B-DISCOReasoning Strategy=DA, # TIR=02026.02 | 33.24 | |
| Gemma3n-E4B-DISCOReasoning Strategy=Table-GLS, # TIR=02026.02 | 32.17 |