Risk Prediction on ICAT 1.0 (test)
72Home E[ηinit]Veo3.1
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Veo3.1Category=Closed, Conditioning=(v, i) only, Sampling protocol=best-of-3 under RCCC2026.03 | 72 | 58 | 23 | 60 | 55 | 30 | 72 | 56 | 20 | 49 | 10.9 | |
| Sora2Category=Closed, Conditioning=(v, i) only, Sampling protocol=best-of-3 under RCCC2026.03 | 72 | 43 | 8 | 58 | 36 | 22 | 72 | 40 | 11 | 41 | 6.9 | |
| Wan2.5Category=Closed, Conditioning=(v, i) only, Sampling protocol=best-of-3 under RCCC2026.03 | 65 | 37 | 1 | 45 | 27 | 2 | 56 | 32 | 0 | 29 | 0 | |
| SkyReels-V2 14BCategory=Open, Conditioning=(v, i) only, Sampling protocol=best-of-3 under RCCC2026.03 | 56 | 28 | 0 | 39 | 23 | 0 | 48 | 28 | 0 | 25 | 0 | |
| Wow-wan 14BCategory=Open, Conditioning=(v, i) only, Sampling protocol=best-of-3 under RCCC2026.03 | 51 | 26 | 0 | 32 | 18 | 0 | 46 | 25 | 0 | 22 | 0 | |
| HunyuanVideoCategory=Open, Conditioning=(v, i) only, Sampling protocol=best-of-3 under RCCC2026.03 | 49 | 23 | 0 | 33 | 21 | 0 | 44 | 24 | 0 | 21 | 0 |