Motion Simulation on Waymo Open Sim Agents Challenge 2025
78.58Realism ScoreSMART-R1
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SMART-R1# model params=7M2025.09 | 78.58 | 49.44 | 81.1 | 92.01 | 1.2885 | |
| TrajTok# model params=10M2025.09 | 78.52 | 48.87 | 81.16 | 92.07 | 1.3179 | |
| UniMotion2026.01 | 78.51 | 49.43 | 81.05 | 91.87 | 1.3036 | |
| CATK2026.01 | 78.46 | 49.31 | 81.06 | 91.77 | 1.3065 | |
| CLSFT# model params=7M2025.09 | 78.46 | 49.31 | 81.06 | 91.77 | 1.3065 | |
| RLFTSim# model params=7M2025.09 | 78.44 | 48.93 | 81.28 | 91.64 | 1.347 | |
| comBOT2025.09 | 78.37 | 48.99 | 81.02 | 91.75 | 1.3687 | |
| UniMM2026.01 | 78.29 | 49.14 | 80.89 | 91.61 | 1.2949 | |
| UniMM# model params=4M2025.09 | 78.29 | 49.14 | 80.89 | 91.61 | 1.2949 | |
| SimFormer# model params=7M2025.09 | 78.2 | 49.2 | 80.6 | 91.67 | 1.3221 | |
| SMART*# model params=7M2025.09 | 78.14 | 48.54 | 80.89 | 91.53 | 1.3931 | |
| LLM2AD2026.01 | 77.79 | 48.46 | 80.48 | 91.09 | 1.2827 | |
| UniTFormer2026.01 | 77.76 | 48.92 | 79.97 | 91.4 | 1.3592 | |
| UniTAM2026.01 | 76.98 | 48.69 | 78.76 | 90.85 | 1.394 |