Chart Design Prediction on Pew+CharXiV (test)
82AccuracyChartDesign
Evaluation results
| Method | Links | |
|---|---|---|
| ChartDesignbackbone=Phi-3, adaptation=Full FT, training_data=Pew+CharXiV2026.04 | 82 | |
| ChartDesignbackbone=Qwen-3, adaptation=LoRA, training_data=Pew+CharXiV2026.04 | 80 | |
| ChartDesignbackbone=Phi-3, adaptation=LoRA, training_data=Pew+CharXiV2026.04 | 72 | |
| ChartDesignbackbone=InternVL-2.5, adaptation=LoRA, training_data=Pew+CharXiV2026.04 | 70 | |
| ChartDesignbackbone=InternVL-2.5, adaptation=LoRA, training_data=Pew2026.04 | 62 | |
| ChartDesignbackbone=Qwen-3, adaptation=LoRA, training_data=Pew2026.04 | 61 | |
| ChartDesignbackbone=Phi-3, adaptation=LoRA, training_data=Pew2026.04 | 60 | |
| Qwen-3adaptation=Few-shot prompting (3-shot), parameters=8B2026.04 | 46 | |
| Llama 3.2adaptation=Zero-shot, parameters=11B, type=base model2026.04 | 32 | |
| Phi-3adaptation=Zero-shot, parameters=4B, type=backbone baseline2026.04 | 32 | |
| Qwen-3adaptation=Zero-shot, parameters=8B, type=backbone baseline2026.04 | 31 | |
| Ministral-3adaptation=Zero-shot, parameters=8B, type=base model2026.04 | 30 | |
| Llama 3adaptation=Zero-shot, parameters=8B, type=base model2026.04 | 30 | |
| Mistraladaptation=Zero-shot, parameters=7B, type=base model2026.04 | 29 | |
| InternLM-3adaptation=Zero-shot, parameters=8B, type=base model2026.04 | 28 | |
| Gemmaadaptation=Zero-shot, parameters=7B, type=base model2026.04 | 28 | |
| Phi-3adaptation=Zero-shot, parameters=4B, type=base model2026.04 | 26 | |
| DeepSeek-LLMadaptation=Zero-shot, parameters=7B, type=base model2026.04 | 25 | |
| InternLM-2.5adaptation=Zero-shot, parameters=8B, type=base model2026.04 | 24 | |
| InternLM-2.5adaptation=Zero-shot, parameters=8B, type=backbone baseline2026.04 | 24 |