Video Understanding on NextQA (accuracy)
86.24AccuracyInternVL-2.5-26B (Reproduction)
Evaluation Results
| Method | Links | |
|---|---|---|
| InternVL-2.5-26B (Reproduction)Backbone=InternVL-2.5-26B, Red. Ratio=0.00%, Latency=2.9142, Speedup=-2025.12 | 86.24 | |
| InternVL-2.5-26B + LUVCBackbone=InternVL-2.5-26B, Red. Ratio=61.32%, Latency=1.2255, Speedup=2.38x2025.12 | 85.63 | |
| InternVL-2.5-26B + PACTBackbone=InternVL-2.5-26B, Red. Ratio=59.61%, Latency=1.3548, Speedup=2.15x2025.12 | 85.52 | |
| InternVL-2.5-26B + VTWBackbone=InternVL-2.5-26B, Red. Ratio=66.67%, Latency=1.2586, Speedup=2.32x2025.12 | 84.46 | |
| InternVL-2.5-8B (Reproduction)Backbone=InternVL-2.5-8B, Red. Ratio=0.00%, Latency=1.2480, Speedup=-2025.12 | 83.43 | |
| InternVL-2.5-8B + LUVCBackbone=InternVL-2.5-8B, Red. Ratio=62.12%, Latency=0.6293, Speedup=1.98x2025.12 | 82.74 | |
| InternVL-2.5-8B + PACTBackbone=InternVL-2.5-8B, Red. Ratio=55.41%, Latency=0.6949, Speedup=1.80x2025.12 | 82.3 | |
| InternVL-2.5-8B + VTWBackbone=InternVL-2.5-8B, Red. Ratio=56.25%, Latency=0.6482, Speedup=1.93x2025.12 | 80.99 | |
| LlavaOV-7BBackbone=LlavaOV-7B, Red. Ratio=0.00%, Latency=0.5194, Speedup=-2025.12 | 79.4 | |
| LlavaOV-7B + PACTBackbone=LlavaOV-7B, Red. Ratio=55.88%, Latency=0.2711, Speedup=1.92x2025.12 | 78.74 | |
| LlavaOV-7B + LUVCBackbone=LlavaOV-7B, Red. Ratio=62.32%, Latency=0.2583, Speedup=2.01x2025.12 | 78.47 | |
| LlavaOV-7B + FastVBackbone=LlavaOV-7B, Red. Ratio=42.86%, Latency=0.2693, Speedup=1.93x2025.12 | 78.08 | |
| LlavaOV-7B + VTWBackbone=LlavaOV-7B, Red. Ratio=57.14%, Latency=0.2524, Speedup=2.06x2025.12 | 65.43 | |
| LlavaOV-0.5B + LUVCBackbone=LlavaOV-0.5B, Red. Ratio=58.46%, Latency=0.0610, Speedup=1.27x2025.12 | 57.33 | |
| LlavaOV-0.5BBackbone=LlavaOV-0.5B, Red. Ratio=0.00%, Latency=0.0772, Speedup=-2025.12 | 57.2 | |
| LlavaOV-0.5B (Reproduction)Backbone=LlavaOV-0.5B, Red. Ratio=0.00%, Latency=0.0772, Speedup=-2025.12 | 57.13 | |
| LlavaOV-0.5B + FastVBackbone=LlavaOV-0.5B, Red. Ratio=41.67%, Latency=0.0711, Speedup=1.00x2025.12 | 56.32 | |
| LlavaOV-0.5B + PACTBackbone=LlavaOV-0.5B, Red. Ratio=48.05%, Latency=0.0642, Speedup=1.20x2025.12 | 55.16 | |
| LlavaOV-0.5B + VTWBackbone=LlavaOV-0.5B, Red. Ratio=54.17%, Latency=0.0596, Speedup=1.30x2025.12 | 53.84 |