Video Captioning on ActivityNet-Captions (test)
12.31METEORMV-GPT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MV-GPTAction Proposals=Ground-truth2022.01 | 12.31 | 6.84 | — | — | |
| OracleVLM=Qwen2.5-VL-3B, k=82026.05 | 11.64 | 4.54 | 46.58 | 22.95 | |
| OracleVLM=Qwen2.5-VL-3B, k=42026.05 | 11.53 | 4.51 | 45.23 | 22.67 | |
| OracleVLM=Qwen2.5-VL-3B, k=22026.05 | 11.25 | 4.34 | 41.67 | 22.05 | |
| HACAAction Proposals=Ground-truth2022.01 | 11.16 | 2.71 | — | — | |
| PEEKVLM=Qwen2.5-VL-3B, k=82026.05 | 11.13 | 4.18 | 42.42 | 22.12 | |
| UniformVLM=Qwen2.5-VL-3B, k=82026.05 | 11.12 | 4.12 | 42.33 | 22.11 | |
| MaxInfoVLM=Qwen2.5-VL-3B, k=82026.05 | 11.08 | 4.09 | 41.91 | 22.08 | |
| RandomVLM=Qwen2.5-VL-3B, k=82026.05 | 11.07 | 4.11 | 41.91 | 22.05 | |
| CSTAVLM=Qwen2.5-VL-3B, k=82026.05 | 11.07 | 4.09 | 42.06 | 22.02 | |
| PEEKVLM=Qwen2.5-VL-3B, k=42026.05 | 10.93 | 4.06 | 40.55 | 21.77 | |
| BMTAction Proposals=Ground-truth2022.01 | 10.9 | 1.99 | — | — | |
| Bi-SSTAction Proposals=Ground-truth2022.01 | 10.89 | — | — | — | |
| MaxInfoVLM=Qwen2.5-VL-3B, k=42026.05 | 10.89 | 3.93 | 39.47 | 21.59 | |
| UniformVLM=Qwen2.5-VL-3B, k=42026.05 | 10.88 | 4 | 39.51 | 21.6 | |
| OracleVLM=Qwen2.5-VL-3B, k=12026.05 | 10.84 | 4.04 | 37.31 | 21.25 | |
| RandomVLM=Qwen2.5-VL-3B, k=42026.05 | 10.84 | 3.96 | 39.54 | 21.59 | |
| CSTAVLM=Qwen2.5-VL-3B, k=42026.05 | 10.79 | 3.88 | 39.16 | 21.46 | |
| PEEKVLM=Qwen2.5-VL-3B, k=22026.05 | 10.61 | 3.8 | 37.02 | 21.06 | |
| UniformVLM=Qwen2.5-VL-3B, k=22026.05 | 10.47 | 3.73 | 35.36 | 20.81 | |
| MaxInfoVLM=Qwen2.5-VL-3B, k=22026.05 | 10.41 | 3.65 | 35.1 | 20.71 | |
| RandomVLM=Qwen2.5-VL-3B, k=22026.05 | 10.39 | 3.67 | 34.99 | 20.71 | |
| CSTAVLM=Qwen2.5-VL-3B, k=22026.05 | 10.29 | 3.6 | 34.53 | 20.6 | |
| PEEKVLM=Qwen2.5-VL-3B, k=12026.05 | 10.13 | 3.45 | 32.39 | 20.21 | |
| OracleVLM=Qwen3.5-4B, k=82026.05 | 10.07 | 3.26 | 40.3 | 20.37 | |
| OracleVLM=Qwen3.5-4B, k=42026.05 | 9.96 | 3.12 | 40.19 | 20.3 | |
| OracleVLM=Qwen3.5-4B, k=22026.05 | 9.76 | 3.08 | 40.64 | 20.35 | |
| UniformVLM=Qwen2.5-VL-3B, k=12026.05 | 9.72 | 3.19 | 30.05 | 19.58 | |
| OracleVLM=Qwen2.5-VL-7B, k=22026.05 | 9.64 | 2.64 | 40.1 | 21.12 | |
| OracleVLM=SmolVLM2-2.2B, k=82026.05 | 9.54 | 3.31 | 39.05 | 20.63 | |
| RandomVLM=Qwen2.5-VL-3B, k=12026.05 | 9.54 | 3.17 | 29.03 | 19.35 | |
| CSTAVLM=Qwen2.5-VL-3B, k=12026.05 | 9.48 | 3.09 | 28.56 | 19.21 | |
| UniformVLM=Qwen3.5-4B, k=82026.05 | 9.37 | 2.76 | 35.42 | 19.3 | |
| PEEKVLM=Qwen3.5-4B, k=82026.05 | 9.37 | 2.8 | 35.31 | 19.29 | |
| OracleVLM=SmolVLM2-2.2B, k=42026.05 | 9.33 | 2.87 | 39.41 | 20.79 | |
| CSTAVLM=Qwen3.5-4B, k=82026.05 | 9.33 | 2.74 | 35.39 | 19.26 | |
| DVCAction Proposals=Ground-truth2022.01 | 9.31 | 1.71 | — | — | |
| RandomVLM=Qwen3.5-4B, k=82026.05 | 9.3 | 2.69 | 34.93 | 19.25 | |
| MaxInfoVLM=Qwen3.5-4B, k=82026.05 | 9.26 | 2.68 | 35.22 | 19.21 | |
| OracleVLM=Qwen2.5-VL-7B, k=12026.05 | 9.24 | 2.6 | 36.6 | 19.59 | |
| PEEKVLM=Qwen3.5-4B, k=42026.05 | 9.2 | 2.73 | 34.93 | 19.22 | |
| OracleVLM=Qwen2.5-VL-7B, k=42026.05 | 9.18 | 2.27 | 38.05 | 20.84 | |
| OracleVLM=SmolVLM2-2.2B, k=22026.05 | 9.14 | 2.66 | 38.19 | 20.5 | |
| RandomVLM=Qwen3.5-4B, k=42026.05 | 9.14 | 2.64 | 34.72 | 19.09 | |
| UniformVLM=Qwen3.5-4B, k=42026.05 | 9.12 | 2.63 | 34.66 | 19.08 | |
| CSTAVLM=Qwen3.5-4B, k=42026.05 | 9.1 | 2.66 | 34.54 | 19.02 | |
| MaxInfoVLM=Qwen3.5-4B, k=42026.05 | 9.08 | 2.6 | 34.44 | 18.97 | |
| OracleVLM=Qwen3.5-4B, k=12026.05 | 9.07 | 2.56 | 38.44 | 19.35 | |
| MaxInfoVLM=Qwen2.5-VL-3B, k=12026.05 | 9.05 | 2.82 | 26.47 | 18.46 | |
| PEEKVLM=Qwen2.5-VL-7B, k=22026.05 | 9.05 | 2.31 | 35.04 | 20.06 | |
| PEEKVLM=SmolVLM2-2.2B, k=82026.05 | 9.02 | 2.96 | 34.33 | 19.7 | |
| OracleVLM=SmolVLM2-2.2B, k=12026.05 | 9 | 2.65 | 37.36 | 20.32 | |
| UniformVLM=SmolVLM2-2.2B, k=82026.05 | 8.95 | 2.94 | 33.85 | 19.52 | |
| CSTAVLM=SmolVLM2-2.2B, k=82026.05 | 8.92 | 2.88 | 33.69 | 19.5 | |
| UniformVLM=Qwen2.5-VL-7B, k=22026.05 | 8.91 | 2.33 | 34.43 | 19.84 | |
| RandomVLM=SmolVLM2-2.2B, k=82026.05 | 8.9 | 2.91 | 33.47 | 19.49 | |
| DCEVAction Proposals=Ground-truth2022.01 | 8.88 | 1.6 | — | — | |
| MaxInfoVLM=Qwen2.5-VL-7B, k=22026.05 | 8.88 | 2.23 | 33.56 | 19.73 | |
| PEEKVLM=Qwen3.5-4B, k=22026.05 | 8.84 | 2.61 | 34.51 | 18.94 | |
| MaxInfoVLM=SmolVLM2-2.2B, k=82026.05 | 8.81 | 2.79 | 33.06 | 19.31 | |
| RandomVLM=Qwen2.5-VL-7B, k=22026.05 | 8.8 | 2.2 | 33.68 | 19.67 | |
| CSTAVLM=Qwen2.5-VL-7B, k=22026.05 | 8.78 | 2.25 | 33.63 | 19.63 | |
| MaxInfoVLM=Qwen2.5-VL-7B, k=42026.05 | 8.73 | 2.12 | 33.92 | 20.11 | |
| PEEKVLM=SmolVLM2-2.2B, k=42026.05 | 8.72 | 2.48 | 33.45 | 19.62 | |
| UniformVLM=Qwen3.5-4B, k=22026.05 | 8.72 | 2.55 | 33.35 | 18.67 | |
| RandomVLM=Qwen3.5-4B, k=22026.05 | 8.7 | 2.5 | 32.93 | 18.67 | |
| MaxInfoVLM=Qwen3.5-4B, k=22026.05 | 8.7 | 2.5 | 32.97 | 18.66 | |
| UniformVLM=Qwen2.5-VL-7B, k=42026.05 | 8.7 | 2.06 | 33.54 | 19.96 | |
| CSTAVLM=Qwen3.5-4B, k=22026.05 | 8.69 | 2.5 | 33.47 | 18.59 | |
| RandomVLM=Qwen2.5-VL-7B, k=42026.05 | 8.69 | 2.07 | 33.55 | 20.01 | |
| PEEKVLM=Qwen2.5-VL-7B, k=42026.05 | 8.67 | 2.03 | 33.15 | 19.92 | |
| CSTAVLM=Qwen2.5-VL-7B, k=42026.05 | 8.62 | 2.03 | 33.02 | 19.89 | |
| UniformVLM=SmolVLM2-2.2B, k=42026.05 | 8.59 | 2.43 | 32.76 | 19.39 | |
| RandomVLM=SmolVLM2-2.2B, k=42026.05 | 8.58 | 2.4 | 32.35 | 19.38 | |
| CSTAVLM=SmolVLM2-2.2B, k=42026.05 | 8.58 | 2.41 | 32.62 | 19.39 | |
| OracleVLM=Qwen2.5-VL-7B, k=82026.05 | 8.58 | 1.92 | 33.88 | 19.69 | |
| PEEKVLM=Qwen2.5-VL-7B, k=12026.05 | 8.58 | 2.26 | 31.54 | 18.54 | |
| PEEKVLM=SmolVLM2-2.2B, k=22026.05 | 8.54 | 2.32 | 32.98 | 19.39 | |
| MaxInfoVLM=SmolVLM2-2.2B, k=42026.05 | 8.47 | 2.32 | 31.91 | 19.23 | |
| PEEKVLM=SmolVLM2-2.2B, k=12026.05 | 8.37 | 2.23 | 31.53 | 19.12 | |
| UniformVLM=SmolVLM2-2.2B, k=22026.05 | 8.31 | 2.19 | 31.23 | 19 | |
| RandomVLM=SmolVLM2-2.2B, k=22026.05 | 8.25 | 2.17 | 31.06 | 18.88 | |
| UniformVLM=Qwen2.5-VL-7B, k=12026.05 | 8.18 | 2 | 28.54 | 17.88 | |
| CSTAVLM=SmolVLM2-2.2B, k=22026.05 | 8.17 | 2.13 | 30.38 | 18.72 | |
| PEEKVLM=Qwen3.5-4B, k=12026.05 | 8.13 | 2.04 | 31.73 | 17.71 | |
| UniformVLM=SmolVLM2-2.2B, k=12026.05 | 8.08 | 2.1 | 29.79 | 18.55 | |
| RandomVLM=Qwen2.5-VL-7B, k=12026.05 | 8.08 | 2.06 | 28.44 | 17.79 | |
| PEEKVLM=Qwen2.5-VL-7B, k=82026.05 | 8.06 | 1.71 | 30.01 | 18.75 | |
| MaxInfoVLM=SmolVLM2-2.2B, k=22026.05 | 8.05 | 2.07 | 29.49 | 18.6 | |
| CSTAVLM=Qwen2.5-VL-7B, k=12026.05 | 8.03 | 2.02 | 28.02 | 17.71 | |
| UniformVLM=Qwen2.5-VL-7B, k=82026.05 | 8.01 | 1.71 | 29.4 | 18.7 | |
| RandomVLM=Qwen2.5-VL-7B, k=82026.05 | 8.01 | 1.68 | 29.58 | 18.72 | |
| CSTAVLM=Qwen2.5-VL-7B, k=82026.05 | 7.99 | 1.69 | 29.77 | 18.75 | |
| MaxInfoVLM=Qwen2.5-VL-7B, k=82026.05 | 7.97 | 1.67 | 29.43 | 18.72 | |
| RandomVLM=SmolVLM2-2.2B, k=12026.05 | 7.85 | 2.03 | 28.4 | 18.18 | |
| CSTAVLM=SmolVLM2-2.2B, k=12026.05 | 7.85 | 1.99 | 28.37 | 18.2 | |
| UniformVLM=Qwen3.5-4B, k=12026.05 | 7.85 | 1.93 | 29.55 | 17.28 | |
| MaxInfoVLM=Qwen2.5-VL-7B, k=12026.05 | 7.76 | 1.99 | 26.44 | 17.2 | |
| RandomVLM=Qwen3.5-4B, k=12026.05 | 7.69 | 1.94 | 28.94 | 17.06 | |
| CSTAVLM=Qwen3.5-4B, k=12026.05 | 7.63 | 1.9 | 28.51 | 16.95 |