List your company
ResearchFormerly WizWand

Table Question Answering on HiTab (Acc., Avg.)

64.71AccuracyTableLlama + Oracle
-2.52614.929532.38549.8405Feb 24, 2025
Updated 8mo ago

Evaluation results

MethodLinks
TableLlama + OracleScale=7B, Modality=Text2025.0264.7155.33
MiniCPM-V-2.6 + HIPPOScale=8B, Modality=Image & Text2025.026365.46
MiniCPM-V-2.6 + Vanilla SFTScale=8B, Modality=Image & Text2025.0262.8861.93
Qwen2.5-VL-InstructScale=7B, Modality=Image & Text2025.0261.9958.58
Qwen2.5-VL-Instruct + HIPPOScale=7B, Modality=Image & Text2025.0260.9762.9
Qwen2.5-VL-Instruct + Vanilla SFTScale=7B, Modality=Image & Text2025.0259.4962.15
Qwen2.5-InstructScale=7B, Modality=Text2025.0258.6961.54
MiniCPM-V-2.6Scale=8B, Modality=Image & Text2025.0258.5662.12
Qwen2.5-VL-Instruct (Image Only)Scale=7B, Modality=Image2025.0256.8256.85
MiniCPM-V-2.6 (Image Only)Scale=8B, Modality=Image2025.0256.5360.42
GPT-4oScale=N/A, Modality=Image & Text2025.0256.0255.58
GPT-4o (Image Only)Scale=N/A, Modality=Image2025.0254.8254.26
Table-LLaVA + HIPPOScale=7B, Modality=Image & Text2025.0247.0155.52
TableLlama + MarkdownScale=7B, Modality=Text2025.0246.5737.86
Table-LLaVAScale=7B, Modality=Image & Text2025.0244.7950.98
Qwen2-72B-InstructScale=72B, Modality=Text2025.0239.2157.11
Table-LLaVA (Image Only)Scale=13B, Modality=Image2025.0210.8538.09
Llama2Scale=7B, Modality=Text2025.0210.7217.53
Table-LLaVA (Image Only)Scale=7B, Modality=Image2025.0210.0935.69
Llama3-InstructScale=8B, Modality=Text2025.026.9731.98
MonkeyScale=7B, Modality=Image2025.026.4114.16
TabPediaScale=7B, Modality=Image2025.025.5820.84
Vary-toyScale=1.8B, Modality=Image2025.023.425.77
LLaVA v1.5Scale=7B, Modality=Image2025.022.039.82
mPLUG-OwlScale=7B, Modality=Image2025.020.253.16
MiniGPT-4Scale=7B, Modality=Image2025.020.20.28
mPLUG-Owl2Scale=7B, Modality=Image2025.020.137.76
InternLM-XComposerScale=7B, Modality=Image2025.020.120.77
Llama3.1-InstructScale=8B, Modality=Text2025.020.0835.42
Qwen-VLScale=7B, Modality=Image2025.020.060.83