List your company
ResearchFormerly WizWand

Table Question Answering on Financial TableQA

85.51Execution AccuracyQwen-2.5-7B
4.44225.488546.53567.5815Apr 23, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Qwen-2.5-7BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=with sketch2026.0485.51
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=with sketch2026.0485.38
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=with sketch2026.0482.31
Qwen-2.5-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=with sketch2026.0481.92
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=with sketch2026.0480.13
Qwen-2.5-7BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=with sketch2026.0479.62
GPT-5Model Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0477.82
Claude-4.5-SonnetModel Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0476.79
Gemini-2.5-ProModel Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0476.41
Qwen-2.5-7BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=with sketch2026.0476.15
Qwen-2.5-7BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=without sketch2026.0475.26
Claude-4.5-SonnetModel Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0473.97
Qwen-2.5-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=with sketch2026.0473.97
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=with sketch2026.0473.97
Qwen-2.5-7BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=with sketch2026.0472.56
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=without sketch2026.0472.18
GPT-5Model Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0471.28
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=with sketch2026.0470.38
Gemini-2.5-ProModel Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0470
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=with sketch2026.0469.74
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=without sketch2026.0469.74
Qwen-2.5-7BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=without sketch2026.0469.1
Qwen-2.5-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=with sketch2026.0468.33
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=with sketch2026.0466.67
Qwen-2.5-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=100%, Sketch Guidance=without sketch2026.0462.69
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=without sketch2026.0462.44
Qwen-2.5-72BModel Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0460.26
Qwen-2.5-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=without sketch2026.0459.23
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=with sketch2026.0457.56
Qwen-2.5-72BModel Scale=>70B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0456.54
Qwen-2.5-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=with sketch2026.0455.9
Qwen-2.5-7BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=without sketch2026.0453.21
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=SFT, Data Percentage=10%, Sketch Guidance=without sketch2026.0452.95
Qwen-2.5-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=without sketch2026.0445.64
Qwen-2.5-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=without sketch2026.0443.85
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=without sketch2026.0441.15
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=without sketch2026.0441.03
Qwen-2.5-7BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0438.08
Qwen-2.5-7BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0435.9
Qwen-2.5-7BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=without sketch2026.0434.62
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=100%, Sketch Guidance=without sketch2026.0431.67
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=TaNOS, Data Percentage=10%, Sketch Guidance=without sketch2026.0431.54
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0423.59
LLaMA-3.1-8BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0421.15
Qwen-2.5-3BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.0413.21
Qwen-2.5-3BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0412.44
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=with sketch2026.0410.64
LLaMA-3.2-3BModel Scale=<10B, Training Protocol=Off-the-shelf, Sketch Guidance=without sketch2026.047.56