Video Understanding on MMEB Video v2
57.8Classification Score (CLS)WAVE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| WAVEModel Size=7B2025.09 | 57.8 | 59.9 | 72.5 | 54.7 | 50.8 | |
| Seed-1.6-Embedding2025.09 | 55 | 55.3 | 60.9 | 51.3 | 53.5 | |
| OmniRetLLM Size=1.5B2026.03 | 48.6 | — | — | 36.5 | 43.3 | |
| PLUMEVenue=Ours, Backbone=Qwen2-VL-2B2026.04 | 45 | 44.1 | 52.3 | 33.5 | 46.7 | |
| UME-R1Venue=ICLR’26, Backbone=Qwen2-VL-2B2026.04 | 44.3 | 42.2 | 51.2 | 32.9 | 39.7 | |
| LamRAModel Size=7B2025.09 | 39.3 | 35 | 42.6 | 24.3 | 32.8 | |
| VLM2VecV2LLM Size=1.5B2026.03 | 39.3 | — | — | 28.8 | 38.5 | |
| LamRAVenue=CVPR’25, Backbone=Qwen2-VL-2B2026.04 | 39.3 | 35.2 | 42.6 | 24.3 | 34.6 | |
| VLM2Vec-V2Venue=TMLR’26, Backbone=Qwen2-VL-2B2026.04 | 39.3 | 34.9 | 34.3 | 28.8 | 38.5 | |
| DUMEVenue=ICLR’26, Backbone=Qwen2-VL-2B2026.04 | 37.7 | 33.2 | 46.6 | 17.1 | 30 | |
| GMEModel Size=7B2025.09 | 37.4 | 38.4 | 50.4 | 28.4 | 37 | |
| CAFeModel Size=7B2025.09 | 35.8 | 42.4 | 58.7 | 34.4 | 39.5 | |
| GMELLM Size=1.5B2026.03 | 34.9 | — | — | 25.6 | 32.4 | |
| GMEVenue=CVPR’25, Backbone=Qwen2-VL-2B2026.04 | 34.9 | 33.9 | 42 | 25.6 | 32.4 | |
| VLM2VecV1LLM Size=1.5B2026.03 | 33.4 | — | — | 20.6 | 33 | |
| VLM2VecVenue=ICLR’25, Backbone=Qwen2-VL-2B2026.04 | 33.4 | 29 | 30.5 | 20.6 | 33 | |
| ColPaliv1.3LLM Size=2B2026.03 | 26.7 | — | — | 21.6 | 25.5 |