Event Question Answering on EventMind 1.0 (test)
64.2FGQAEventFlash-7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EventFlash-7BParams=7B, LLM Backbone=Qwen-2.5, Max Bins=1,0002026.02 | 64.2 | 87.6 | 63.1 | |
| EventFlash-3BParams=3B, LLM Backbone=Qwen-2.5, Max Bins=1,0002026.02 | 61.1 | 84.9 | 60 | |
| EventFlash-ZeroParams=3B, LLM Backbone=Qwen-2.5, Max Bins=1,0002026.02 | 60.4 | 85 | 58.2 | |
| LLaVA-Next-VideoParams=7B, LLM Backbone=Qwen2.5, Max Bins=562026.02 | 44.6 | 22.8 | 42.7 | |
| Qwen2.5 VLParams=7B, LLM Backbone=Qwen2.5, Max Bins=7682026.02 | 43.9 | 28.6 | 41.8 | |
| VideoChat2-FlashParams=7B, LLM Backbone=Qwen2.5, Max Bins=1,0002026.02 | 41.9 | 18.9 | 48.2 | |
| Qwen2.5 VLParams=3B, LLM Backbone=Qwen2.5, Max Bins=7682026.02 | 41.7 | 23.8 | 34.6 | |
| InternVL2.5Params=8B, LLM Backbone=InternLM2.52026.02 | 40 | 25.3 | 38.2 | |
| VideoChat2-FlashParams=2B, LLM Backbone=Qwen2.5, Max Bins=1,0002026.02 | 38.9 | 16.2 | 43.6 | |
| InternVL2.5Params=4B, LLM Backbone=Qwen2.52026.02 | 37 | 21.3 | 27.3 |