Motion-to-text retrieval on HumanML3D 1.0 (test)
68.64R@1LAVIMO
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LAVIMOProtocol=(d) Small batches, Modality=3-modal2024.03 | 68.64 | 81.06 | 85.52 | 88.76 | 92.82 | 1.01 | |
| TMRProtocol=(d) Small batches2024.03 | 67.97 | 81.2 | 86.35 | 91.7 | 95.27 | 1.03 | |
| LAVIMOProtocol=(d) Small batches, Modality=2-modal2024.03 | 67.87 | 79.62 | 84.08 | 88.27 | 91.61 | 1.01 | |
| LAVIMOProtocol=(c) Dissimilar subset, Modality=3-modal2024.03 | 56 | 73 | 81 | 86 | 92 | 1 | |
| LAVIMOProtocol=(c) Dissimilar subset, Modality=2-modal2024.03 | 52 | 65 | 70 | 77 | 80 | 1 | |
| Guo et al.Protocol=(d) Small batches2024.03 | 52 | 71.21 | 81.11 | 89.87 | 96.78 | 1.38 | |
| TMRProtocol=(c) Dissimilar subset2024.03 | 47 | 55 | 65 | 71 | 78 | 2.5 | |
| MotionCLIPProtocol=(d) Small batches2024.03 | 44.76 | 56.81 | 65.22 | 77.83 | 90.19 | 2.03 | |
| TEMOSProtocol=(d) Small batches2024.03 | 39.96 | 53.49 | 61.79 | 72.4 | 85.89 | 2.33 | |
| TEMOSProtocol=(c) Dissimilar subset2024.03 | 24 | 30 | 39 | 47 | 62 | 6.74 | |
| Guo et al.Protocol=(c) Dissimilar subset2024.03 | 24 | 39 | 46 | 58 | 71 | 4.5 | |
| MotionCLIPProtocol=(c) Dissimilar subset2024.03 | 21 | 36 | 45 | 53 | 69 | 5.12 | |
| LAVIMOProtocol=(b) All with threshold, Modality=3-modal2024.03 | 13.89 | 17.11 | 23.83 | 29.93 | 41.09 | 17.5 | |
| TMRProtocol=(b) All with threshold2024.03 | 13.2 | 15.73 | 22.03 | 27.65 | 37.63 | 21.5 | |
| LAVIMOProtocol=(b) All with threshold, Modality=2-modal2024.03 | 12.95 | 17.56 | 22.69 | 29.05 | 39.58 | 19 | |
| TMRProtocol=(a) All2024.03 | 9.95 | 12.44 | 17.95 | 23.56 | 32.69 | 28.5 | |
| LAVIMOProtocol=(a) All, Modality=3-modal2024.03 | 9.72 | 13.33 | 18.73 | 25 | 36.55 | 22.5 | |
| LAVIMOProtocol=(a) All, Modality=2-modal2024.03 | 8.08 | 12.3 | 16.85 | 23.39 | 34.64 | 23.5 | |
| MotionCLIPProtocol=(b) All with threshold2024.03 | 7.1 | 10.21 | 13.57 | 20.04 | 25.44 | 53.87 | |
| TEMOSProtocol=(b) All with threshold2024.03 | 5.48 | 6.19 | 9 | 12.01 | 17.1 | 129 | |
| MotionCLIPProtocol=(a) All2024.03 | 5.12 | 6.97 | 8.35 | 12.46 | 19.02 | 91.42 | |
| Guo et al.Protocol=(b) All with threshold2024.03 | 4.95 | 5.68 | 8.93 | 11.64 | 16.94 | 69.5 | |
| TEMOSProtocol=(a) All2024.03 | 3.86 | 4.54 | 6.94 | 9.38 | 14 | 183.25 | |
| Guo et al.Protocol=(a) All2024.03 | 2.92 | 3.74 | 6 | 8.36 | 12.95 | 81.5 |