# Video Summarization on SumMe single ground truth (test) Source: [Video Summarization on SumMe single ground truth (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:43:29.952Z Evaluation of video summarization performance using the F1-score metric on the test split of the SumMe dataset, specifically utilizing the single ground truth annotations. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Video Summarization | | Dataset (including any stated split) | SumMe single ground truth (test) | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | SUM-GAN-GEA | 65.9 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | Semantic-Guided Unsupervised Video Summarization | 63.7 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | DMFF | 62.7 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | AC-SUM-GAN | 60.7 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | SUM-GAN-AAE | 56.9 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | SUM-GAN-sl | 46.8 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | AALVS | 46.2 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | SASUM | 45.3 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | Cycle-SUMsup | 44.8 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | DTR-GAN | 44.6 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | M-AVS | 44.4 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | A-AVS | 43.9 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | Cycle-SUMdpp | 42.3 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | Cycle-sum | 41.9 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | SUM-GANsup | 41.7 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | SUM-GANdpp | 39.1 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | | SUM-GAN | 38.7 | Not recorded | 6971af0ce25ad2fa9d1ed9e9 | ### SUM-GAN-GEA F1 Score: 65.9. Result ID: 6996256e5698665ec4663269. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### Semantic-Guided Unsupervised Video Summarization F1 Score: 63.7. Result ID: 6996256e5698665ec4663270. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### DMFF F1 Score: 62.7. Result ID: 6996256e5698665ec4663265. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### AC-SUM-GAN F1 Score: 60.7. Result ID: 6996256e5698665ec466326a. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### SUM-GAN-AAE F1 Score: 56.9. Result ID: 6996256e5698665ec4663268. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### SUM-GAN-sl F1 Score: 46.8. Result ID: 6996256e5698665ec4663267. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### AALVS F1 Score: 46.2. Result ID: 6996256e5698665ec4663264. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Supervised"}. This record does not assert independent reproduction. ### SASUM F1 Score: 45.3. Result ID: 6996256e5698665ec4663260. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Supervised"}. This record does not assert independent reproduction. ### Cycle-SUMsup F1 Score: 44.8. Result ID: 6996256e5698665ec466326f. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### DTR-GAN F1 Score: 44.6. Result ID: 6996256e5698665ec4663261. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Supervised"}. This record does not assert independent reproduction. ### M-AVS F1 Score: 44.4. Result ID: 6996256e5698665ec4663263. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Supervised"}. This record does not assert independent reproduction. ### A-AVS F1 Score: 43.9. Result ID: 6996256e5698665ec4663262. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Supervised"}. This record does not assert independent reproduction. ### Cycle-SUMdpp F1 Score: 42.3. Result ID: 6996256e5698665ec466326e. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### Cycle-sum F1 Score: 41.9. Result ID: 6996256e5698665ec4663266. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### SUM-GANsup F1 Score: 41.7. Result ID: 6996256e5698665ec466326d. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### SUM-GANdpp F1 Score: 39.1. Result ID: 6996256e5698665ec466326c. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. ### SUM-GAN F1 Score: 38.7. Result ID: 6996256e5698665ec466326b. [Reporting paper]() Recorded evaluation configuration: {"Supervision":"Unsupervised"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.