Keystep recognition on CrossTask (test)
28.9AccuracyVideo-Mined Task Graphs
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Video-Mined Task GraphsModality=Video-Text, Evaluation Protocol=Zero-shot2023.07 | 28.9 | 6.7 | |
| Video-Mined Task GraphsModality=Video-only, Evaluation Protocol=Zero-shot2023.07 | 28.6 | 6.6 | |
| VideoCLIPModality=Video-only, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Linear StepsModality=Video-only, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Auto-RegModality=Video-only, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Pruning KeystepsModality=Video-only, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| VideoCLIPModality=Video-Text, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Linear StepsModality=Video-Text, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Auto-RegModality=Video-Text, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Pruning KeystepsModality=Video-Text, Evaluation Protocol=Zero-shot2023.07 | 28.5 | 6.5 | |
| Video-Mined Task GraphsModality=Text-only, Evaluation Protocol=Zero-shot2023.07 | 20 | 4.9 | |
| Auto-RegModality=Text-only, Evaluation Protocol=Zero-shot2023.07 | 16.4 | 3.7 | |
| Pruning KeystepsModality=Text-only, Evaluation Protocol=Zero-shot2023.07 | 16.4 | 3.8 | |
| Linear StepsModality=Text-only, Evaluation Protocol=Zero-shot2023.07 | 16.3 | 3.8 | |
| DistantSup.Modality=Text-only, Evaluation Protocol=Zero-shot2023.07 | 16.1 | 3.7 | |
| RandomModality=Text-only, Evaluation Protocol=Zero-shot2023.07 | 0.01 | 0.01 | |
| RandomModality=Video-only, Evaluation Protocol=Zero-shot2023.07 | 0.01 | 0.01 | |
| RandomModality=Video-Text, Evaluation Protocol=Zero-shot2023.07 | 0.01 | 0.01 |