Narration Quality Evaluation on SciVidEval
16.67Perplexity (PPL)NotebookLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| NotebookLM2025.09 | 16.67 | 7 | 8.76 | |
| Source Paper2025.09 | 17.46 | 100 | 10 | |
| VideoAgentBackbone=GPT-4o, Summary Mode=Default Sequential Summary2025.09 | 18.08 | 16 | 9.38 | |
| VideoAgentBackbone=Gemini-2.5 Pro, Summary Mode=Default Sequential Summary2025.09 | 18.32 | 14 | 9.7 | |
| VideoAgentBackbone=Qwen-2.5VL-7B, Summary Mode=Default Sequential Summary2025.09 | 18.42 | 8 | 9.31 | |
| LunWenShuo2025.09 | 22.76 | 12 | 8.6 | |
| Author2025.09 | 23.93 | 11 | 8.13 | |
| Pictory2025.09 | 25.68 | 6 | 9 |