Video comment generation on Livebot (test)
20.34R@1ComHeat
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| ComHeat2024.09 | 20.34 | 47.31 | 66.31 | 9.36 | 0.32 | 4.97 | 4.29 | 4.58 | |
| UT2024.09 | 18.01 | 38.12 | 55.78 | 16.01 | 0.28 | 4.31 | 3.07 | 3.45 | |
| FRNN2024.09 | 17.25 | 37.96 | 56.1 | 16.14 | 0.27 | 4.45 | 2.95 | 3.34 | |
| KLVCG+variant=enhanced2024.09 | 14.88 | 44.81 | 62.5 | 11.91 | 0.3 | — | — | — | |
| KLVCG2024.09 | 13.49 | 41.43 | 59.31 | 13.09 | 0.28 | — | — | — | |
| S2S-IC2024.09 | 12.89 | 33.78 | 50.29 | 17.05 | 0.25 | 4.07 | 2.23 | 2.91 | |
| MML-CG2024.09 | 10.42 | 36.43 | 54.81 | 15.64 | 0.24 | — | — | — | |
| Humantype=ground truth / human evaluation2024.09 | — | — | — | — | — | 4.82 | 3.31 | 4.11 |