Video Summarization on MovieSum (test)
34.47Visual Reconstruction ScoreGold Screenplay
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gold ScreenplayInput Source=Gold Screenplay, Summarization model=Gemini 2.5 Flash2025.12 | 34.47 | 35.48 | 34.97 | 47.43 | 11.88 | 45.34 | 34.06 | |
| Built Screenplay (reference clips)Clip selection strategy=reference clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 22.43 | 35.38 | 28.9 | 47.28 | 11.67 | 45.21 | 34.14 | |
| our clips two-shot (Qwen2.5-Omni-7B)Number of clips (K)=75, Clip selection strategy=our clips, Evaluation protocol=two-shot, Selection model=Qwen2.5-Omni-7B, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 22.25 | 33.45 | 27.85 | 46.53 | 10.8 | 44.32 | 33.55 | |
| our clips two-shot (Qwen2.5-Omni-7B)Number of clips (K)=25, Clip selection strategy=our clips, Evaluation protocol=two-shot, Selection model=Qwen2.5-Omni-7B, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 21.05 | 34.01 | 27.53 | 46.9 | 11.55 | 44.69 | 33.93 | |
| our clips zero-shot (Qwen2.5-Omni-7B)Number of clips (K)=50, Clip selection strategy=our clips, Evaluation protocol=zero-shot, Selection model=Qwen2.5-Omni-7B, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 20.97 | 33.63 | 27.3 | 46.54 | 11.22 | 44.49 | 33.63 | |
| our clips zero-shot (Qwen2.5-Omni-7B)Number of clips (K)=75, Clip selection strategy=our clips, Evaluation protocol=zero-shot, Selection model=Qwen2.5-Omni-7B, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 20.87 | 31.25 | 26.06 | 46.04 | 10.75 | 43.87 | 33.13 | |
| our clips zero-shot (Qwen2.5-Omni-7B)Number of clips (K)=25, Clip selection strategy=our clips, Evaluation protocol=zero-shot, Selection model=Qwen2.5-Omni-7B, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 20.81 | 35.64 | 28.23 | 46.29 | 11.2 | 44.16 | 33.59 | |
| our clips two-shot (Qwen2.5-Omni-7B)Number of clips (K)=50, Clip selection strategy=our clips, Evaluation protocol=two-shot, Selection model=Qwen2.5-Omni-7B, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 20.6 | 34.22 | 27.41 | 46.22 | 10.97 | 44.1 | 33.46 | |
| silent clipsNumber of clips (K)=75, Clip selection strategy=silent clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 19.43 | 32.42 | 25.92 | 46 | 10.84 | 43.83 | 33.37 | |
| silent clipsNumber of clips (K)=50, Clip selection strategy=silent clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 17.53 | 31.82 | 24.67 | 46.1 | 11.32 | 43.95 | 33.36 | |
| silent clipsNumber of clips (K)=25, Clip selection strategy=silent clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 16.33 | 32.61 | 24.47 | 46.24 | 10.95 | 44.11 | 33.24 | |
| random clipsNumber of clips (K)=50, Clip selection strategy=random clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 15.68 | 30.91 | 23.29 | 46.11 | 10.51 | 43.88 | 33.21 | |
| random clipsNumber of clips (K)=25, Clip selection strategy=random clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 15.44 | 31.93 | 23.69 | 46.11 | 10.61 | 44.07 | 33.27 | |
| random clipsNumber of clips (K)=75, Clip selection strategy=random clips, Recaptioning model=Gemini 2.5 Flash-Lite, Summarization model=Gemini 2.5 Flash2025.12 | 14.68 | 30.9 | 22.79 | 45.35 | 10.34 | 43.15 | 32.73 | |
| Transcripts (no video)Input Source=Transcripts, Summarization model=Gemini 2.5 Flash2025.12 | 14.42 | 26.89 | 20.65 | 44.66 | 10.35 | 42.64 | 32.12 |