Motion Understanding on Nymeria 1.0 (test)
19.97BERT ScoreEgoLM (TPV2M + MV2T)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| EgoLM (TPV2M + MV2T)Input Modality: 3pts=true, Input Modality: Motion=false, Input Modality: Vid.=true2024.09 | 19.97 | 45.41 | 12.81 | 35.04 | |
| EgoLM (Joint Training)Input Modality: 3pts=true, Input Modality: Motion=true, Input Modality: Vid.=true2024.09 | 19.4 | 45.45 | 12.72 | 34.82 | |
| EgoLM (TPV2T)Input Modality: 3pts=true, Input Modality: Motion=false, Input Modality: Vid.=true2024.09 | 18.38 | 44.55 | 12.12 | 33.8 | |
| EgoLM (V2T)Input Modality: 3pts=false, Input Modality: Motion=false, Input Modality: Vid.=true2024.09 | 16.62 | 43.03 | 11.34 | 33.13 | |
| EgoLM (M2T&T2M)Input Modality: 3pts=false, Input Modality: Motion=true, Input Modality: Vid.=false2024.09 | 15.9 | 42.68 | 11.06 | 33.71 | |
| MotionGPTInput Modality: 3pts=false, Input Modality: Motion=true, Input Modality: Vid.=false2024.09 | 14.09 | 42.22 | 10.31 | 32.33 | |
| EgoLM (TP2T)Input Modality: 3pts=true, Input Modality: Motion=false, Input Modality: Vid.=false2024.09 | 11.94 | 41.7 | 9.85 | 31.47 | |
| TM2TInput Modality: 3pts=false, Input Modality: Motion=true, Input Modality: Vid.=false2024.09 | 11.08 | 40.11 | 8.99 | 30.7 |