Semantic Tagging on ScanNet (val)
90.14APmidQwen3-VL-2B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-VL-2BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 90.14 | 93.56 | 96.3 | |
| InternVL3-8BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 89 | 93.17 | 95.5 | |
| Qwen3-VL-4BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 88.62 | 92.47 | 95.8 | |
| InternVL3.5-4BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 87.98 | 91.84 | 95.8 | |
| Qwen2.5-VL-7BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 87.64 | 91.62 | 95.7 | |
| InternVL3-1BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 87.53 | 92.52 | 94.6 | |
| InternVL3.5-8BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 87.49 | 91.65 | 95.5 | |
| InternVL3-2BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 86.88 | 92.34 | 94.1 | |
| Qwen2.5-VL-3BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 84.04 | 90.59 | 92.8 | |
| Qwen3-VL-8BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Vision-Language Models2026.05 | 83.49 | 91.08 | 91.7 | |
| WAN2.1-T2V-14BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 71.04 | 80 | 88.8 | |
| WAN2.1-I2V-14BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 60.02 | 69.51 | 86.3 | |
| WAN2.1-T2V-1.3BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 59.6 | 68.04 | 87.6 | |
| CogVideoX-T2V-2BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 58.2 | 71.45 | 81.5 | |
| AetherProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 57.02 | 66.43 | 85.8 | |
| OpenSora2.0Probing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 56.38 | 67.02 | 84.1 | |
| CogVideoX-T2V-5BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 55.14 | 69.29 | 79.6 | |
| CogVideoX-I2V-5BProbing=Frozen representations, Evaluation=Unified probe, Model Category=Video-Generation Models2026.05 | 51.65 | 67.39 | 76.6 |