3D Human Pose Estimation on UnrealEgo
33.4MPJPEEgoPoseFormer
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| EgoPoseFormerParams=14.1 M, FLOPS=7.3 G, Backbone=ResNet-182024.03 | 33.4 | 32.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EgoTAPcomponents=Grid ViT + PU2024.02 | 41.06 | 35.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ego3DPose2024.02 | 53.99 | 43.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ego3DPoseParams=178.4 M, FLOPS=55.6 G2024.03 | 60.8 | 48.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnrealEgo2024.02 | 63.53 | 47.76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnrealEgoSettings=Stereo, ImageNet pre-training=true2022.08 | 79.06 | 59.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnrealEgoParams=106.8 M, FLOPS=27.1 G2024.03 | 79.1 | 59.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EgoGlass2024.02 | 81.55 | 61.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EgoGlassParams=107.3 M, FLOPS=16.1 G2024.03 | 83.3 | 61.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UnrealEgoSettings=Stereo, ImageNet pre-training=false2022.08 | 87.31 | 64.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EgoGlassSettings=Stereo, ImageNet pre-training=true2022.08 | 91.44 | 70.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EgoGlassSettings=Stereo, ImageNet pre-training=false2022.08 | 107.7 | 84.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| xR-EgoPoseSettings=Monocular, ImageNet pre-training=true2022.08 | 112.86 | 88.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| xR-EgoPoseSettings=Monocular, ImageNet pre-training=false2022.08 | 123.15 | 96.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ego3DPose2023.09 | — | — | 60.82 | 48.47 | 60.84 | 49.41 | 95.78 | 79.17 | 76.15 | 63.31 | 58.08 | 45.69 | 51.75 | 41.05 | 81.94 | 71.16 | 148.72 | 105.14 | 83.36 | 69.85 | 153.81 | 133.37 | 93.59 | 79.64 | 109.05 | 89.97 | 65.34 | 48.7 | 53.99 | 45.94 | 58.13 | 46.9 | 50.37 | 39.9 | 50.51 | 37.19 | 58.52 | 48.08 | 59.64 | 52.78 | 55.71 | 48.72 | 51.96 | 42.58 | 60.93 | 51.22 | 61.3 | 50.82 | 49.91 | 40.25 | 65.48 | 51.76 | 54.46 | 43.7 | 69.25 | 55.58 | 48.39 | 35.83 | 83.28 | 72.96 | 54.52 | 38.1 | |
| EgoGlass2023.09 | — | — | 83.33 | 61.56 | 81.33 | 63.42 | 131.64 | 94.7 | 100.17 | 74.11 | 81.96 | 62.07 | 70.59 | 52.57 | 103.29 | 92.66 | 182.36 | 113.65 | 109.64 | 81.75 | 207.31 | 144.72 | 132.74 | 110.83 | 128.5 | 100.83 | 82.3 | 60.48 | 79.23 | 65.41 | 94.77 | 77.98 | 70.17 | 51.55 | 70.18 | 46.32 | 77.72 | 59.29 | 77.82 | 70.02 | 77.34 | 62.27 | 75.13 | 58.47 | 85.19 | 67.76 | 83.72 | 65.5 | 71.38 | 54.25 | 86.09 | 65.28 | 82.29 | 58.24 | 77.69 | 61.04 | 59.68 | 47.73 | 102.15 | 80.56 | 69.37 | 48.22 | |
| UnrealEgo2023.09 | — | — | 79.08 | 59.26 | 76.63 | 61.13 | 126.82 | 95.99 | 90.27 | 68.36 | 78.2 | 61.39 | 67.34 | 49.85 | 86.26 | 71.61 | 181.5 | 116.42 | 97.84 | 76.62 | 194.34 | 150.33 | 116.77 | 97.88 | 128.23 | 104.32 | 76.8 | 55.18 | 73.6 | 61.89 | 78.19 | 62.01 | 68.47 | 50.1 | 66.54 | 45.44 | 74.33 | 57.92 | 74.09 | 61.25 | 70.79 | 56.61 | 68.13 | 55.17 | 78.92 | 62.27 | 79.99 | 63.2 | 68.69 | 51.39 | 83.73 | 64.47 | 78.32 | 56.24 | 72.81 | 56.73 | 60.48 | 45.41 | 99.56 | 81.81 | 73.86 | 49.01 |