Video Hallucination Evaluation on VERHallu
0.506CFQAQwenVL-2.5-7B
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| QwenVL-2.5-7BFrames=fps=12026.01 | 0.506 | 0.408 | 0.505 | 0.407 | 0.149 | 0.249 | 0.206 | 27.8 | |
| MiniCPM-V-2 6-7BFrames=122026.01 | 0.364 | 0.329 | 0.339 | 0.333 | 0.141 | 0.276 | 0.168 | 24.6 | |
| VideoLLaMA3-7BFrames=fps=12026.01 | 0.319 | 0.159 | 0.208 | 0.194 | 0.473 | 0.405 | 0.441 | 38.7 | |
| InternVL-2.5-8BFrames=82026.01 | 0.293 | 0.284 | 0.274 | 0.329 | 0.221 | 0.309 | 0.242 | 26.4 | |
| QwenVL-2-7BFrames=fps=12026.01 | 0.281 | 0.419 | 0.368 | 0.364 | 0.114 | 0.239 | 0.176 | 22.9 | |
| mPLUG-Owl3-7B(1101)Frames=162026.01 | 0.206 | 0.376 | 0.368 | 0.364 | 0.119 | 0.223 | 0.154 | 20.5 | |
| mPLUG-Owl3-7B(0728)Frames=162026.01 | 0.158 | 0.392 | 0.392 | 0.337 | 0.114 | 0.255 | 0.162 | 20.3 | |
| InternVL-3-8BFrames=82026.01 | 0.156 | 0.354 | 0.429 | 0.364 | 0.268 | 0.28 | 0.302 | 27.6 | |
| Random2026.01 | 0.143 | 0.143 | 0.143 | 0.143 | 0.333 | 0.333 | 0.333 | — | |
| LLaVA-Onevision-7BFrames=642026.01 | 0.133 | 0.308 | 0.344 | 0.395 | 0.101 | 0.249 | 0.163 | 19.9 | |
| VideoChat-R1-7BFrames=fps=12026.01 | 0.094 | 0.408 | 0.387 | 0.384 | 0.117 | 0.251 | 0.187 | 22.6 | |
| ShareGPT4Video-8BFrames=fps=0.52026.01 | 0.044 | 0.217 | 0.241 | 0.287 | 0.089 | 0.255 | 0.149 | 7.6 | |
| Video-LLaVA-7BFrames=82026.01 | 0.033 | 0.121 | 0.137 | 0.112 | 0.12 | 0.249 | 0.171 | 6.5 | |
| LLaVA-NeXT-7B-DPOFrames=322026.01 | 0.029 | 0.179 | 0.17 | 0.167 | 0.086 | 0.249 | 0.139 | 4.9 | |
| LLaVA-NeXT-7BFrames=322026.01 | 0.027 | 0.15 | 0.15 | 0.12 | 0.094 | 0.247 | 0.167 | 5.7 |