# Video Summarization on SumMe (5FCV)

Source: [Video Summarization on SumMe (5FCV)](<https://www.sota2.com/research/sota/video-summarization-on-summe-5fcv>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-12T12:21:55.855Z

Evaluation of video summarization performance on the SumMe dataset using the 5-Fold Cross-Validation (5FCV) configuration, reporting correlation metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Video Summarization |
| Dataset (including any stated split) | SumMe (5FCV) |
| Metric | Kendall's Tau |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Kendall's Tau](<https://www.sota2.com/research/sota/video-summarization-on-summe-5fcv.md?metric=Kendall%27s%20Tau>): Higher is better; unit: SCALAR.

- [Spearman's Rho](<https://www.sota2.com/research/sota/video-summarization-on-summe-5fcv.md?metric=Spearman%27s%20Rho>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Kendall's Tau | Result date | Report paper |
| --- | --- | --- | --- |
| SummDiff | 0.256 | Not recorded | 6a02b46cdbc836b87d824b61 |
| VASTSum | 0.253 | Not recorded | 6a02b46cdbc836b87d824b61 |
| CSTA | 0.246 | Not recorded | 6a02b46cdbc836b87d824b61 |
| Human | 0.205 | Not recorded | 6a02b46cdbc836b87d824b61 |
| SSPVS | 0.192 | Not recorded | 6a02b46cdbc836b87d824b61 |
| VASNet | 0.16 | Not recorded | 6a02b46cdbc836b87d824b61 |
| A2Summ | 0.108 | Not recorded | 6a02b46cdbc836b87d824b61 |
| AC-SUM-GAN | 0.102 | Not recorded | 6a02b46cdbc836b87d824b61 |
| iPTNet | 0.101 | Not recorded | 6a02b46cdbc836b87d824b61 |
| DMASum | 0.063 | Not recorded | 6a02b46cdbc836b87d824b61 |
| DSNet-AB | 0.051 | Not recorded | 6a02b46cdbc836b87d824b61 |
| SUM-GAN | 0.049 | Not recorded | 6a02b46cdbc836b87d824b61 |
| DSNet-AF | 0.037 | Not recorded | 6a02b46cdbc836b87d824b61 |
| Random | 0 | Not recorded | 6a02b46cdbc836b87d824b61 |

### SummDiff

Kendall's Tau: 0.256. Result ID: 6a031b4747f34ce924e73c44.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bfb1e209131cea8b955.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### VASTSum

Kendall's Tau: 0.253. Result ID: 6a031b4747f34ce924e73c45.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### CSTA

Kendall's Tau: 0.246. Result ID: 6a031b4747f34ce924e73c43.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa734b1e209131cea5b9f2.md>)

[Implementation](<https://github.com/thswodnjs3/CSTA>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### Human

Kendall's Tau: 0.205. Result ID: 6a031b4747f34ce924e73c39.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### SSPVS

Kendall's Tau: 0.192. Result ID: 6a031b4747f34ce924e73c42.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6da91e209131cea3b417.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### VASNet

Kendall's Tau: 0.16. Result ID: 6a031b4747f34ce924e73c40.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65641e209131cea09ec4.md>)

[Implementation](<https://github.com/ok1zjf/VASNet>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### A2Summ

Kendall's Tau: 0.108. Result ID: 6a031b4747f34ce924e73c3f.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fb01e209131cea46e8b.md>)

[Implementation](<https://boheumd.github.io/A2Summ/>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### AC-SUM-GAN

Kendall's Tau: 0.102. Result ID: 6a031b4747f34ce924e73c3d.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### iPTNet

Kendall's Tau: 0.101. Result ID: 6a031b4747f34ce924e73c3e.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### DMASum

Kendall's Tau: 0.063. Result ID: 6a031b4747f34ce924e73c41.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa682a1e209131cea1a71c.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### DSNet-AB

Kendall's Tau: 0.051. Result ID: 6a031b4747f34ce924e73c3b.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### SUM-GAN

Kendall's Tau: 0.049. Result ID: 6a031b4747f34ce924e73c3c.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### DSNet-AF

Kendall's Tau: 0.037. Result ID: 6a031b4747f34ce924e73c3a.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

### Random

Kendall's Tau: 0. Result ID: 6a031b4747f34ce924e73c38.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b46cdbc836b87d824b61.md>)

Recorded evaluation configuration: {"Evaluation Protocol":"5FCV","Summary Budget":"15%","Scoring":"shot-level","Optimization":"0/1 knapsack"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
