Action Step Localization on CrossTask 1.0 (test)
19.1Kimchi Rice ScoreSupervised
Evaluation Results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Supervisedsupervision=Full2019.03 | 19.1 | — | 25.3 | 38 | 37.5 | 25.7 | 28.2 | 54.3 | 25.8 | 18.3 | 31.2 | 47.7 | 12 | 39.5 | 23.4 | 30.9 | 41.1 | 53.4 | 17.3 | 31.6 | |
| Alayrac' 16supervision=Weak, model=Visual model only2019.03 | 15.6 | — | 10.6 | 7.5 | 14.2 | 9.3 | 11.8 | 17.3 | 13.1 | 6.4 | 12.9 | 27.2 | 9.2 | 15.7 | 8.6 | 16.3 | 13 | 23.2 | 7.4 | 13.3 | |
| Proposedsupervision=Weak, sharing=across tasks2019.03 | 13.3 | — | 18 | 23.4 | 23.1 | 16.9 | 16.5 | 30.7 | 21.6 | 4.6 | 19.5 | 35.3 | 10 | 32.3 | 13.8 | 29.5 | 37.6 | 43 | 13.3 | 22.4 | |
| Task-Specific Step-Basedsupervision=Weak, sharing=none2019.03 | 13.2 | — | 17.6 | 19.3 | 19.3 | 9.7 | 12.6 | 30.4 | 16 | 4.5 | 19 | 29 | 9.1 | 29.1 | 14.5 | 22.9 | 29 | 32.9 | 7.3 | 18.6 | |
| Richard' 18supervision=Weak2019.03 | 7.6 | — | 4.3 | 3.6 | 4.6 | 8.9 | 5.4 | 7.5 | 7.3 | 3.6 | 6.2 | 12.3 | 3.8 | 7.4 | 7.2 | 6.7 | 9.6 | 12.3 | 3.1 | 6.7 | |
| Uniformsupervision=Weak2019.03 | 4.2 | — | 7.1 | 6.4 | 7.3 | 17.4 | 7.1 | 14.2 | 9.8 | 3.1 | 10.7 | 22.1 | 5.5 | 9.5 | 7.5 | 9.2 | 9.2 | 19.5 | 5.1 | 9.7 |