Class-to-image generation on ImageNet (Quality and Latency)
3.01Speedup33% steps
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| 33% stepsModel=DiT-MoE, Sampling Steps=33%2026.06 | 3.01 | 0.0464 | 39.82 | — | 50.38 | 54.47 | — | — | |
| FORAN=5, Sparsity (%)=80, Backbone=DiT-XL/22026.05 | 2.87 | — | 6.58 | 11.29 | — | — | — | — | |
| DuCaN=5, Sparsity (%)=80, Backbone=DiT-XL/22026.05 | 2.78 | — | 6.06 | 6.72 | — | — | — | — | |
| 37% stepsModel=DiT-MoE, Sampling Steps=37%2026.06 | 2.69 | 0.0518 | 37.26 | — | 51.17 | 60.95 | — | — | |
| ToCaN=6, Sparsity (%)=83, Backbone=DiT-XL/22026.05 | 2.63 | — | 6.55 | 7.1 | — | — | — | — | |
| Test-time Sparsityρ=80%, Sparsity (%)=80, Backbone=DiT-XL/22026.05 | 2.63 | — | 2.23 | 4.37 | — | — | — | — | |
| PrediT4_1,0.3Steps=70, Backbone=DiT-XL/2, order=4, r=1, tau=0.32026.02 | 2.48 | 0.314 | 2.24 | 4.77 | 239.54 | — | — | — | |
| TaylorSeerN=5, Sparsity (%)=80, Backbone=DiT-XL/22026.05 | 2.38 | — | 2.65 | 5.36 | — | — | — | — | |
| FORA3Steps=70, Backbone=DiT-XL/22026.02 | 2.33 | 0.335 | 2.85 | 5.4 | 241.42 | — | — | — | |
| MoECaModel Variant=DSMoE-S-E48, Acceleration Method=MoECa2026.06 | 2.31 | 0.0792 | 40.58 | — | 38.35 | 15.38 | 29.447 | 71.45 | |
| 33% stepsModel Variant=DSMoE-S-E48, Acceleration Method=33% steps2026.06 | 2.3 | 0.0795 | 53.47 | — | 36.98 | 14.37 | 28.094 | 67.84 | |
| 37% stepsModel Variant=DSMoE-S-E48, Acceleration Method=37% steps2026.06 | 2.25 | 0.0813 | 49.85 | — | 37.36 | 16.08 | 28.231 | 68.47 | |
| PrediT4_1,0.1Steps=70, Backbone=DiT-XL/2, order=4, r=1, tau=0.12026.02 | 2.19 | 0.356 | 2.15 | 4.61 | 245.15 | — | — | — | |
| MoECaModel Variant=DSMoE-S-E16, Acceleration Method=MoECa2026.06 | 2.17 | 0.0296 | 40.39 | — | 38.67 | 19.27 | 29.418 | 71.42 | |
| DuCaModel Variant=DSMoE-S-E48, Acceleration Method=DuCa2026.06 | 2.15 | 0.0849 | 41.34 | — | 38.28 | 16.32 | 29.314 | 71.36 | |
| MoECaModel Variant=DSMoE-L-E48, Acceleration Method=MoECa2026.06 | 2.14 | 0.165 | 9.54 | — | 118.53 | 218.31 | 30.229 | 78.08 | |
| MoECaModel=DiT-MoE2026.06 | 2.13 | 0.0502 | 30.76 | — | 53.72 | 76.98 | — | — | |
| ToCaModel Variant=DSMoE-S-E48, Acceleration Method=ToCa2026.06 | 2.12 | 0.0863 | 41.62 | — | 38.26 | 16.51 | 29.087 | 70.71 | |
| PrediT4_1,0.3Steps=50, Backbone=DiT-XL/2, order=4, r=1, tau=0.32026.02 | 2.12 | 0.268 | 2.24 | 4.78 | 239.55 | — | — | — | |
| 33% stepsModel Variant=DSMoE-L-E48, Acceleration Method=33% steps2026.06 | 2.11 | 0.1669 | 15.91 | — | 116.87 | 205.26 | 28.792 | 72.31 | |
| 33% stepsModel Variant=DSMoE-S-E16, Acceleration Method=33% steps2026.06 | 2.1 | 0.0306 | 51.28 | — | 37.41 | 17.81 | 28.087 | 67.76 | |
| MoECaModel Variant=DSMoE-L-E16, Acceleration Method=MoECa2026.06 | 2.06 | 0.0687 | 10.21 | — | 115.19 | 263.39 | 30.227 | 78.19 | |
| 37% stepsModel Variant=DSMoE-S-E16, Acceleration Method=37% steps2026.06 | 2.05 | 0.0314 | 48.96 | — | 37.58 | 19.93 | 28.215 | 68.31 | |
| TeaCacheModel Variant=DSMoE-S-E48, Acceleration Method=TeaCache2026.06 | 2.05 | 0.0892 | 40.89 | — | 38.28 | 18.97 | 29.286 | 71.04 | |
| 37% stepsModel Variant=DSMoE-L-E48, Acceleration Method=37% steps2026.06 | 2.03 | 0.1733 | 13.68 | — | 117.46 | 229.67 | 28.947 | 72.65 | |
| DuCaModel Variant=DSMoE-L-E48, Acceleration Method=DuCa2026.06 | 2.03 | 0.1738 | 10.01 | — | 118.42 | 234.02 | 29.978 | 76.42 | |
| FORA3Steps=50, Backbone=DiT-XL/22026.02 | 2.03 | 0.28 | 3.52 | 6.39 | 226.18 | — | — | — | |
| 33% stepsModel Variant=DSMoE-L-E16, Acceleration Method=33% steps2026.06 | 2 | 0.0707 | 16.37 | — | 113.84 | 242.31 | 28.784 | 72.27 | |
| 37% stepsModel Variant=DSMoE-L-E16, Acceleration Method=37% steps2026.06 | 1.99 | 0.0712 | 14.26 | — | 114.12 | 271.14 | 28.961 | 72.73 | |
| ToCaModel Variant=DSMoE-L-E48, Acceleration Method=ToCa2026.06 | 1.99 | 0.1772 | 10.14 | — | 118.37 | 236.71 | 29.836 | 75.18 | |
| DuCaModel=DiT-MoE2026.06 | 1.98 | 0.0542 | 31.28 | — | 53.55 | 82.63 | — | — | |
| DuCaModel Variant=DSMoE-L-E16, Acceleration Method=DuCa2026.06 | 1.97 | 0.0719 | 10.58 | — | 115.17 | 278.39 | 29.963 | 76.56 | |
| DuCaModel Variant=DSMoE-S-E16, Acceleration Method=DuCa2026.06 | 1.96 | 0.0328 | 40.83 | — | 38.64 | 20.31 | 29.276 | 71.37 | |
| TeaCacheModel Variant=DSMoE-L-E16, Acceleration Method=TeaCache2026.06 | 1.95 | 0.0725 | 10.47 | — | 115.14 | 327.08 | 30.174 | 77.62 | |
| ToCaModel Variant=DSMoE-S-E16, Acceleration Method=ToCa2026.06 | 1.94 | 0.0332 | 41.16 | — | 38.7 | 20.25 | 29.122 | 70.82 | |
| ToCaModel Variant=DSMoE-L-E16, Acceleration Method=ToCa2026.06 | 1.94 | 0.0728 | 10.72 | — | 115.21 | 277.71 | 29.861 | 75.44 | |
| ToCaModel=DiT-MoE2026.06 | 1.94 | 0.0555 | 31.42 | — | 53.48 | 84.52 | — | — | |
| TeaCacheModel Variant=DSMoE-L-E48, Acceleration Method=TeaCache2026.06 | 1.91 | 0.1845 | 9.76 | — | 118.47 | 272.17 | 30.238 | 77.76 | |
| TeaCacheModel Variant=DSMoE-S-E16, Acceleration Method=TeaCache2026.06 | 1.9 | 0.0339 | 40.59 | — | 38.62 | 24.04 | 29.33 | 70.97 | |
| PrediT4_1,0.1Steps=50, Backbone=DiT-XL/2, order=4, r=1, tau=0.12026.02 | 1.84 | 0.309 | 2.23 | 4.6 | 240.1 | — | — | — | |
| TeaCacheModel=DiT-MoE2026.06 | 1.79 | 0.0549 | 31.13 | — | 53.52 | 91.61 | — | — | |
| FORA2Steps=70, Backbone=DiT-XL/22026.02 | 1.73 | 0.449 | 2.43 | 4.59 | 244.19 | — | — | — | |
| FORA2Steps=50, Backbone=DiT-XL/22026.02 | 1.72 | 0.331 | 2.73 | 4.9 | 234.57 | — | — | — | |
| TaylorSeer3_3Steps=70, Backbone=DiT-XL/22026.02 | 1.41 | 0.553 | 10.12 | 16.35 | 175.62 | — | — | — | |
| TaylorSeer3_3Steps=50, Backbone=DiT-XL/22026.02 | 1.39 | 0.409 | 2.41 | 4.69 | 235.83 | — | — | — | |
| L2C0.5Steps=50, Backbone=DiT-XL/22026.02 | 1.25 | 0.455 | 2.39 | 4.4 | 235.75 | — | — | — | |
| DDIMSteps=50, Backbone=DiT-XL/22026.02 | 1 | 0.569 | 2.28 | 4.25 | 242.26 | — | — | — | |
| DDIMSteps=70, Backbone=DiT-XL/22026.02 | 1 | 0.779 | 2.21 | 4.29 | 243.92 | — | — | — | |
| DDIMSteps=50, Sparsity (%)=0, Backbone=DiT-XL/22026.05 | 1 | — | 2.18 | 4.21 | — | — | — | — | |
| DiT-MoEModel=DiT-MoE2026.06 | 1 | 0.1037 | 28.83 | — | 54.14 | 163.98 | — | — | |
| DSMoE-S-E16Model Variant=DSMoE-S-E162026.06 | 1 | 0.0643 | 39.82 | — | 38.57 | 53.62 | — | — | |
| DSMoE-S-E48Model Variant=DSMoE-S-E482026.06 | 1 | 0.1828 | 40.21 | — | 38.31 | 43.25 | — | — | |
| DSMoE-L-E16Model Variant=DSMoE-L-E162026.06 | 1 | 0.1414 | 9.81 | — | 115.26 | 729.38 | — | — | |
| DSMoE-L-E48Model Variant=DSMoE-L-E482026.06 | 1 | 0.3523 | 9.2 | — | 118.42 | 617.83 | — | — |