Diagram Question Answering on AI2D no mask
82.5AccuracyRADIOv2.5-H
Evaluation results
| Method | Links | |
|---|---|---|
| RADIOv2.5-HResolution=768^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 82.5 | |
| RADIOv2.5-gResolution=672^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 80.8 | |
| SigLIP-SO400MResolution=384^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 80.7 | |
| RADIOv2.5-LResolution=768^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 79.2 | |
| RADIOv2.1-HResolution=512^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 78.9 | |
| OpenAI-CLIPResolution=336^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 77.6 | |
| RADIOv2.1-HResolution=768^2, Tokens/im=196, LLM=MN-Minitron-8B, Data mixture=LLaVA1.62024.12 | 73.4 |