Physical Plausibility Verification on PhysicsIQ MAGI-1 24B I2V (N=16)
30.6Spatial IoUOracle (Upper bound)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Oracle (Upper bound)N=16, Generator=MAGI-1 24B (I2V)2026.06 | 30.6 | 22.4 | 19.5 | 0.009 | 40.2 | |
| GEOPHYSN=16, Generator=MAGI-1 24B (I2V)2026.06 | 27.6 | 23.5 | 18.1 | 0.008 | 38.6 | |
| Qwen2.5-VLN=16, Generator=MAGI-1 24B (I2V)2026.06 | 26.2 | 13.4 | 15.6 | 0.013 | 29.7 | |
| Qwen3-VLN=16, Generator=MAGI-1 24B (I2V)2026.06 | 26 | 17.4 | 15.7 | 0.011 | 32.3 | |
| BaselineN=16, Generator=MAGI-1 24B (I2V)2026.06 | 24.5 | 15.5 | 14.2 | 0.011 | 29.5 | |
| WMRewardN=16, Generator=MAGI-1 24B (I2V)2026.06 | 23.4 | 23.2 | 14.8 | 0.009 | 34.3 | |
| VideoMAEN=16, Generator=MAGI-1 24B (I2V)2026.06 | 20.5 | 12.2 | 11.9 | 0.016 | 23.5 |