Visual Quality Evaluation on SciVidEval
10VLM-as-Judge ScoreSource Paper
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Source Paper2025.09 | 10 | — | — | |
| VideoAgentBackbone=Gemini-2.5 Pro, Summary Mode=Default Sequential Summary2025.09 | 8.03 | 21.33 | 79.24 | |
| VideoAgentBackbone=GPT-4o, Summary Mode=Default Sequential Summary2025.09 | 7.7 | 25.78 | 73.31 | |
| VideoAgentBackbone=Qwen-2.5VL-7B, Summary Mode=Default Sequential Summary2025.09 | 7.37 | 27.92 | 63.65 | |
| AutoSlides2025.09 | 6.64 | 17.31 | 38.37 | |
| PresentAgent2025.09 | 5.97 | 26.64 | 66.75 | |
| Author2025.09 | 4.74 | 19.46 | 88.62 | |
| LunWenShuo2025.09 | 3.76 | 24.08 | 48.57 | |
| NotebookLM2025.09 | 3.16 | 15.37 | 31.99 |