Question Answering on HiTab (test)
63AccuracyMiniCPM-V-2.6 8B
Evaluation results
| Method | Links | |
|---|---|---|
| MiniCPM-V-2.6 8BReasoning Strategy=HIPPO, # TIR=55.2K2026.02 | 63 | |
| Qwen2-VL-7B-Table-R1Reasoning Strategy=GRPO, # TIR=20.6K2026.02 | 58.2 | |
| Qwen3-VL-8BReasoning Strategy=DA, # TIR=02026.02 | 35.47 | |
| Qwen3-VL-8B-DISCOReasoning Strategy=DA, # TIR=02026.02 | 33.5 | |
| Qwen3-VL-8B-DISCOReasoning Strategy=Table-GLS, # TIR=02026.02 | 27.35 | |
| Gemma3n-E4B-DISCOReasoning Strategy=Table-GLS, # TIR=02026.02 | 22.08 | |
| GPT-4o-miniReasoning Strategy=DA, # TIR=02026.02 | 20.94 | |
| Gemma3n-E4B-DISCOReasoning Strategy=DA, # TIR=02026.02 | 16.81 | |
| Gemma3n-E4BReasoning Strategy=DA, # TIR=02026.02 | 14.15 | |
| Table-LLaVA 13BReasoning Strategy=SFT, # TIR=82K2026.02 | 10.85 | |
| Table-LLaVA 7BReasoning Strategy=SFT, # TIR=82K2026.02 | 10.09 |