Image Captioning on Nocaps (Performance/Latency)
109.37Primary ScoreBaseline
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BaselineModel=LLaVA-v1.5-13B, FLOPS Ratio=0%2025.03 | 109.37 | 28.79 | 16,032 | 22.98 | |
| TopVModel=LLaVA-v1.5-13B, FLOPS Ratio=35%2025.03 | 108.23 | 28.32 | 14,428 | 26.15 | |
| FastVModel=LLaVA-v1.5-13B, FLOPS Ratio=48%2025.03 | 107.71 | 29.37 | 31,429 | 12.12 | |
| TopVModel=LLaVA-v1.5-13B, FLOPS Ratio=50%2025.03 | 107.67 | 28.02 | 13,852 | 27.61 | |
| BaselineModel=LLaVA-v1.5-7B, FLOPS Ratio=0%2025.03 | 105.67 | 13.93 | 17,230 | 22.1 | |
| TopVModel=LLaVA-v1.5-7B, FLOPS Ratio=35%2025.03 | 104.12 | 13.78 | 16,539 | 25.77 | |
| FastVModel=LLaVA-v1.5-7B, FLOPS Ratio=47%2025.03 | 104.08 | 14.07 | 35,108 | 10.86 | |
| TopVModel=LLaVA-v1.5-7B, FLOPS Ratio=51%2025.03 | 103.52 | 13.7 | 15,801 | 25.81 | |
| TopVModel=InternVL2-26B, FLOPS Ratio=47%2025.03 | 95.02 | 56.11 | 32,029 | 10.42 | |
| FastVModel=InternVL2-26B, FLOPS Ratio=46%2025.03 | 93.62 | 57.93 | 91,012 | 3.66 | |
| BaselineModel=InternVL2-26B, FLOPS Ratio=0%2025.03 | 92.76 | 56.74 | 37,101 | 8.98 | |
| TopVModel=InternVL2-2B, FLOPS Ratio=48%2025.03 | 64.16 | 5.45 | 13,020 | 32.17 | |
| BaselineModel=InternVL2-2B, FLOPS Ratio=0%2025.03 | 60.34 | 6.23 | 15,010 | 30.41 | |
| FastVModel=InternVL2-2B, FLOPS Ratio=47%2025.03 | 60.22 | 6.58 | 43,257 | 10.55 |