Ego-Exo4D
Benchmarks
TaskDatasetSOTA resultTrendResults
Ego-Exo4D
64.06Prediction Accuracy
48
Ego-Exo4D Bike Repair
29.03Top-1 Accuracy
16
Ego-Exo4D
65.41Bouldering Proficiency Score
16
Ego-Exo4D
55.1Overall Top-1 Accuracy
16
Ego-Exo4D Exo-to-Ego
68IoU
15
Ego-Exo4D Ego-to-Exo
67.7IoU
15
Ego-Exo4D (val)
38.54Rotation Only AUC@5
13
Ego-Exo4D 1.0 (test)
22.5Recall@50
13
Ego-Exo4D 1.0 (test)
45.8BLEU-4
13
Ego-Exo4D Ego+Exos view 1.0 (demonstration proficiency)
21.34mAPS
12
Ego-Exo4D Exos view 1.0 (demonstration proficiency)
21.12mAPS
12
Ego-Exo4D Ego view 1.0 (demonstration proficiency)
21.82mAPS
12
Ego-Exo4D Cooking (test)
55.74Top-1 Accuracy
11
Ego-Exo4D Correspondences v2 (test)
49.6IoU
11
Ego-Exo4D Correspondences v2 (test)
46.3IoU
11
Ego-Exo4D v2 (test)
42.57Ego Query IoU
11
Ego-Exo4D M views
35Recall@1
10
Ego-Exo4D E views
36Recall@1
10
Ego-in-Exo Perception (Ego-Exo4D)
81.8Action Understanding Accuracy
8
Ego-Exo4D Cooking
0.062L2 Error (2s)
7
Ego-Exo4D Bike
0.048L2 Distance (2s)
7
Ego-Exo4D Demonstrator Proficiency
44.2Accuracy
7
Ego-Exo4D Keystep |V|=375 (test)
2.98Success Rate (SR)
6
Ego-Exo4D
24.07Top-1 Accuracy
6
Ego-Exo4D Cooking
55.74Top-1 Accuracy
5