Visual Question Answering on OK-VQA (Performance & Operational)
58.2ScoreBaseline
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaselineModel=LLaVA-v1.5-13B, FLOPS Ratio=0%2025.03 | 58.2 | 28.39 | 1,859 | 10.08 | |
| TopVModel=LLaVA-v1.5-13B, FLOPS Ratio=35%2025.03 | 58.02 | 27.91 | 1,712 | 10.99 | |
| FastVModel=LLaVA-v1.5-13B, FLOPS Ratio=48%2025.03 | 58.02 | 28.89 | 2,519 | 7.43 | |
| TopVModel=LLaVA-v1.5-13B, FLOPS Ratio=50%2025.03 | 57.92 | 27.63 | 1,646 | 11.27 | |
| BaselineModel=LLaVA-v1.5-7B, FLOPS Ratio=0%2025.03 | 53.38 | 13.98 | 1,942 | 9.54 | |
| TopVModel=LLaVA-v1.5-7B, FLOPS Ratio=35%2025.03 | 52.96 | 13.81 | 1,837 | 10.91 | |
| FastVModel=LLaVA-v1.5-7B, FLOPS Ratio=47%2025.03 | 52.87 | 14.04 | 2,608 | 7.19 | |
| TopVModel=LLaVA-v1.5-7B, FLOPS Ratio=51%2025.03 | 52.64 | 13.76 | 1,720 | 10.97 | |
| BaselineModel=InternVL2-26B, FLOPS Ratio=0%2025.03 | 48.41 | 56.93 | 8,948 | 3.19 | |
| FastVModel=InternVL2-26B, FLOPS Ratio=46%2025.03 | 48.23 | 58.17 | 13,502 | 2.12 | |
| TopVModel=InternVL2-26B, FLOPS Ratio=47%2025.03 | 48.12 | 56.08 | 8,121 | 3.53 | |
| BaselineModel=InternVL2-2B, FLOPS Ratio=0%2025.03 | 43.59 | 6.28 | 2,024 | 9.46 | |
| FastVModel=InternVL2-2B, FLOPS Ratio=47%2025.03 | 43.28 | 6.56 | 3,102 | 6.22 | |
| TopVModel=InternVL2-2B, FLOPS Ratio=48%2025.03 | 43.02 | 5.47 | 1,817 | 10.79 |