Video Understanding on Temp Compass (test)
74.2ScoreVideo-ToC
Evaluation results
| Method | Links | |
|---|---|---|
| Video-ToCFrames=322026.04 | 74.2 | |
| Video-ToCFrames=642026.04 | 74.2 | |
| Video-ToC-SFTFrames=642026.04 | 73.9 | |
| Video-ToCFrames=162026.04 | 73.8 | |
| Video-ToC-SFTFrames=322026.04 | 73.7 | |
| VideoChat-R1Frames=162026.04 | 73.5 | |
| Video-R1Frames=322026.04 | 73.2 | |
| Video-R1Frames=642026.04 | 73.2 | |
| Baseline (Qwen2.5-VL-7B)Frames=642026.04 | 72.9 | |
| Video-ToC-SFTFrames=162026.04 | 72.8 | |
| PLM-8BModel=PLM-8B, Pruning Strength=None2026.03 | 72.7 | |
| Video-R1Frames=162026.04 | 72.6 | |
| Baseline (Qwen2.5-VL-7B)Frames=322026.04 | 72.6 | |
| Baseline (Qwen2.5-VL-7B)Frames=162026.04 | 72.2 | |
| Qwen3-VL-4BModel=Qwen3-VL-4B, Pruning Strength=None2026.03 | 70.8 | |
| InternVL3.5-8BModel=InternVL3.5-8B, Pruning Strength=None2026.03 | 70.3 | |
| Video-R1-SFTFrames=642026.04 | 70 | |
| BaselineModel=Baseline, Pruning Strength=0%2026.03 | 69.9 | |
| Video-R1-SFTFrames=322026.04 | 69.9 | |
| STTSModel=STTS, Pruning Strength=30%2026.03 | 69.6 | |
| STTSModel=STTS, Pruning Strength=40%2026.03 | 69.3 | |
| STTSModel=STTS, Pruning Strength=50%2026.03 | 69.2 | |
| Video-R1-SFTFrames=162026.04 | 69.2 | |
| VILA-1.5-8BFrames=-2026.04 | 58.8 | |
| LongVA-7BFrames=-2026.04 | 56.9 |