Free-form Description Evaluation on EventHallusion
2.52LLM Likert ScoreVPS (J = 4)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| VPS (J = 4)Model=Qwen2.5-VL-7B, Nframe=162025.09 | 2.52 | 50.8 | 19.8 | |
| BaselineModel=Gemma3-12B, Nframe=82025.09 | 2.51 | 48.7 | 17.3 | |
| BaselineModel=Qwen2.5-VL-7B, Nframe=82025.09 | 2.5 | 49.2 | 19.7 | |
| VPS (J = 4)Model=Gemma3-12B, Nframe=82025.09 | 2.49 | 48.9 | 18.8 | |
| VPS (J = 4)Model=Qwen2.5-VL-7B, Nframe=42025.09 | 2.47 | 48.7 | 19.5 | |
| VPS (J = 4)Model=Qwen2.5-VL-7B, Nframe=82025.09 | 2.43 | 49.8 | 19.9 | |
| BaselineModel=Qwen2.5-VL-7B, Nframe=42025.09 | 2.41 | 48 | 19.2 | |
| VPS (J = 4)Model=Gemma3-12B, Nframe=162025.09 | 2.4 | 48.5 | 18.5 | |
| VPS (J = 4)Model=InternVL3-8B, Nframe=82025.09 | 2.39 | 45 | 9.24 | |
| VPS (J = 4)Model=InternVL3-8B, Nframe=162025.09 | 2.33 | 44.8 | 9.29 | |
| BaselineModel=Gemma3-12B, Nframe=162025.09 | 2.33 | 48.4 | 17.9 | |
| BaselineModel=InternVL3-8B, Nframe=82025.09 | 2.3 | 43 | 9.26 | |
| BaselineModel=Gemma3-12B, Nframe=42025.09 | 2.26 | 48.2 | 17.8 | |
| VPS (J = 4)Model=Qwen2.5-VL-7B, Nframe=22025.09 | 2.25 | 46.1 | 19.8 | |
| BaselineModel=InternVL3-8B, Nframe=162025.09 | 2.24 | 44.5 | 9.2 | |
| VPS (J = 4)Model=InternVL3-8B, Nframe=42025.09 | 2.23 | 43 | 9.1 | |
| VPS (J = 4)Model=Gemma3-12B, Nframe=42025.09 | 2.21 | 48.4 | 17.5 | |
| BaselineModel=InternVL3-8B, Nframe=42025.09 | 2.18 | 42.1 | 9.14 | |
| VPS (J = 4)Model=InternVL3-8B, Nframe=22025.09 | 2.14 | 43.7 | 9.89 | |
| BaselineModel=InternVL3-8B, Nframe=22025.09 | 2.09 | 41.9 | 9.24 | |
| BaselineModel=Qwen2.5-VL-7B, Nframe=22025.09 | 2.06 | 44.3 | 19.8 | |
| BaselineModel=Qwen2.5-VL-7B, Nframe=162025.09 | 2.05 | 43.5 | 19.2 | |
| VPS (J = 4)Model=Gemma3-12B, Nframe=22025.09 | 2.05 | 47.5 | 18.7 | |
| BaselineModel=Gemma3-12B, Nframe=22025.09 | 1.94 | 45.8 | 18 |