Video Paragraph Captioning on ActivityNet Captions ae (test)
14.5BLEU@4VLTinT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VLTinTInput=C3D/Ling2022.11 | 14.5 | 17.97 | 31.13 | 36.56 | — | 77.72 | 4.75 | |
| VLCapInput=C3D + Language2022.06 | 13.38 | 17.48 | 30.29 | 35.99 | — | 78.29 | 4.18 | |
| OursSegment Annotation Train=false, Segment Annotation Infer=false2021.05 | 12.2 | 16.1 | 27.36 | 2.63 | 68.33 | 84.26 | — | |
| Memory Trans.Venue=CVPR, Input=I3D2022.11 | 11.74 | 15.64 | 26.55 | — | — | 83.95 | 2.75 | |
| VanillaSegment Annotation Train=false, Segment Annotation Infer=false2021.05 | 11.53 | 15.91 | 24.11 | 3.17 | 64.92 | 82.34 | — | |
| AdvInfSegment Annotation Train=true, Segment Annotation Infer=true2021.05 | 10.89 | 17.41 | 20.4 | 5.09 | 60.59 | 78.29 | — | |
| MART w/ COOTYear=NIPS2020, Input=COOT2022.06 | 10.85 | 15.99 | 28.19 | — | — | — | 6.64 | |
| MART^COOTVenue=NIPS, Input=COOT2022.11 | 10.85 | 15.99 | 28.19 | — | — | — | 6.64 | |
| MART+Segment Annotation Train=true, Segment Annotation Infer=true2021.05 | 10.54 | 17.12 | 24.14 | 5.32 | 61.41 | 77.43 | — | |
| VTransformerSegment Annotation Train=true, Segment Annotation Infer=true2021.05 | 10.38 | 16.33 | 21.05 | 7.42 | 61.45 | 77.36 | — | |
| MFTSegment Annotation Train=true, Segment Annotation Infer=true2021.05 | 10.33 | 15.09 | 19.56 | 15.88 | — | — | — | |
| Transformer-XLsentence-level recurrence=true2020.05 | 10.25 | 14.91 | 21.71 | 8.79 | — | — | — | |
| Transformer-XLYear=ACL2019, Input=Res200 + Flow2022.06 | 10.25 | 14.91 | 21.71 | 30.25 | — | 76.17 | 8.79 | |
| Trans.-XLVenue=ACL, Input=Res200/Flow2022.11 | 10.25 | 14.91 | 21.71 | 30.25 | — | 76.17 | 8.79 | |
| Transformer-XLRGsentence-level recurrence=true2020.05 | 10.07 | 14.58 | 20.34 | 9.37 | — | — | — | |
| Transformer-XLRGYear=ACL2020, Input=Res200 + Flow2022.06 | 10.07 | 14.58 | 20.34 | — | — | — | 9.37 | |
| Trans.-XLRGVenue=ACL, Input=Res200/Flow2022.11 | 10.07 | 14.58 | 20.34 | — | — | — | 9.37 | |
| MARTsentence-level recurrence=true2020.05 | 9.78 | 15.57 | 22.16 | 5.44 | — | — | — | |
| MARTYear=ACL2020, Input=Res200 + Flow2022.06 | 9.78 | 15.57 | 22.16 | 30.85 | — | 75.69 | 5.44 | |
| MARTVenue=ACL, Input=Res200/Flow2022.11 | 9.78 | 15.57 | 22.16 | 30.85 | — | 75.69 | 5.44 | |
| VTransformersentence-level recurrence=false2020.05 | 9.31 | 15.54 | 21.33 | 7.45 | — | — | — | |
| Vanilla TransformerYear=CVPR2018, Input=Res200 + Flow2022.06 | 9.31 | 15.54 | 21.33 | 28.98 | — | 77.29 | 7.45 | |
| Vanilla Trans.Venue=CVPR, Input=Res200/Flow2022.11 | 9.31 | 15.54 | 21.33 | 28.98 | — | 77.29 | 7.45 | |
| MFTSegment Annotation Train=true, Segment Annotation Infer=false2021.05 | 8.45 | 14.75 | 14.15 | 17.59 | — | — | — | |
| Human2020.05 | — | — | — | 0.98 | — | — | — | |
| Human2021.05 | — | — | — | 0.83 | 68.6 | 85.4 | — |