Physical Plausibility Verification on PhysicsIQ MAGI-1 4.5B I2V (N=16)
30.4Spatial IoUOracle (Upper bound)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Oracle (Upper bound)N=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 30.4 | 24.5 | 16.1 | 0.017 | 40.2 | |
| Qwen3-VLN=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 22.7 | 19.3 | 11.7 | 0.015 | 30.1 | |
| GEOPHYSN=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 22.5 | 23.2 | 12.8 | 0.007 | 34 | |
| Qwen2.5-VLN=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 16.8 | 13.2 | 7.2 | 0.018 | 20.3 | |
| WMRewardN=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 14.8 | 20.5 | 8.2 | 0.012 | 25.6 | |
| BaselineN=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 14.3 | 13.3 | 7 | 0.019 | 18.8 | |
| VideoMAEN=16, Generator=MAGI-1 4.5B (I2V)2026.06 | 12.2 | 4.4 | 4.2 | 0.029 | 15 |