Video prediction on Kinetics-600 (test)
2.97FVDIV-VAE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| IV-VAEParams=108M, FCR=4*8*8, Chn=162024.11 | 2.97 | — | — | 39.02 | 96.85 | 0.0228 | — | |
| CogX-VAEParams=215M, FCR=4*8*8, Chn=162024.11 | 3.17 | — | — | 38.38 | 96.77 | 0.0287 | — | |
| Causal VAEParams=127M, FCR=4*8*8, Chn=162024.11 | 3.28 | — | — | 38.07 | 96.41 | 0.0289 | — | |
| W.A.L.T-Lparams.=313M, steps=502023.12 | 3.3 | — | — | — | — | — | — | |
| IV-VAEParams=107M, FCR=4*8*8, Chn=82024.11 | 3.94 | — | — | 36.66 | 95.2 | 0.036 | — | |
| MAGVITv2params.=307M, steps=242023.12 | 4.3 | — | — | — | — | — | — | |
| Causal VAEParams=127M, FCR=4*8*8, Chn=82024.11 | 5.72 | — | — | 36.08 | 94.79 | 0.0403 | — | |
| SVD VAEParams=97M, FCR=1*8*8, Chn=42024.11 | 6.26 | — | — | 35.26 | 93.63 | 0.0368 | — | |
| IV-VAEParams=107M, FCR=4*8*8, Chn=42024.11 | 8.01 | — | — | 34.29 | 92.81 | 0.0521 | — | |
| MAGVITparams.=306M, steps=122023.12 | 9.9 | — | — | — | — | — | — | |
| OD-VAEParams=239M, FCR=4*8*8, Chn=42024.11 | 10.69 | — | — | 33.88 | 92.42 | 0.0549 | — | |
| RINSteps=1000, GFLOPS=386, Param (M)=4112022.12 | 10.8 | — | 17.7 | — | — | — | — | |
| RINparams.=411M, steps=10002023.12 | 10.8 | — | — | — | — | — | — | |
| Causal VAEParams=127M, FCR=4*8*8, Chn=42024.11 | 10.81 | — | — | 33.77 | 92.48 | 0.0631 | — | |
| RINSteps=400, GFLOPS=386, Param (M)=4112022.12 | 11.5 | — | 17.7 | — | — | — | — | |
| Video Diffusionsampler=Langevin, steps=1282022.04 | 16.2 | — | 15.64 | — | — | — | — | |
| Video Diffusionparams.=1.1B, steps=2562023.12 | 16.2 | — | — | — | — | — | — | |
| Video Diffusionreconstruction guidance=true, GFLOPS=4136, Param (M)=11002022.12 | 16.6 | — | 15.64 | — | — | — | — | |
| CV-VAEParams=182M, FCR=4*8*8, Chn=42024.11 | 16.81 | — | — | 31.58 | 90.66 | 0.0827 | — | |
| Video Diffusionsampler=ancestral, steps=2562022.04 | 18.6 | — | 15.39 | — | — | — | — | |
| OS VAEParams=393M, FCR=4*8*8, Chn=42024.11 | 19.05 | — | — | 34.37 | 92.58 | 0.0816 | — | |
| Transframer2022.04 | 25.4 | — | — | — | — | — | — | |
| Transframer2022.12 | 25.4 | — | — | — | — | — | — | |
| TrIVD-GAN-FP2022.12 | 25.7 | — | 12.54 | — | — | — | — | |
| TrIVD-GAN-FPsteps=12023.12 | 25.7 | — | — | — | — | — | — | |
| TRIVD-GAN-FPResolution=64 x 642021.03 | 25.74 | — | — | — | — | — | — | |
| TrIVD-GAN-FPpredicted frames=11, conditioned frames=5, frame skipping=false2020.03 | 25.74 | — | 12.54 | — | — | — | — | |
| TrIVD-GAN-FP2022.04 | 25.74 | — | 12.54 | — | — | — | — | |
| Phenakiparams.=227M, steps=482023.12 | 36.4 | — | — | — | — | — | — | |
| Video VQ-VAEResolution=64 x 64, Evaluation Protocol=FVD* (Samples vs Reconstructions)2021.03 | 54.3 | — | — | — | — | — | — | |
| CCVS2022.04 | 55 | — | — | — | — | — | — | |
| Video VQ-VAEResolution=64 x 642021.03 | 64.3 | — | — | — | — | — | — | |
| Video VQ-VAE2022.04 | 64.3 | — | — | — | — | — | — | |
| Video VQ-VAE2022.12 | 64.3 | — | — | — | — | — | — | |
| DVD-GAN-FP2022.04 | 69.1 | — | — | — | — | — | — | |
| DVD-GAN-FP2022.12 | 69.1 | — | — | — | — | — | — | |
| DVD-GAN-FPResolution=64 x 642021.03 | 69.15 | — | — | — | — | — | — | |
| DVD-GAN-FPpredicted frames=11, conditioned frames=5, frame skipping=false2020.03 | 69.15 | — | — | — | — | — | — | |
| Video VQ-VAEResolution=256 x 256, Evaluation Protocol=FVD* (Samples vs Reconstructions)2021.03 | 82.45 | — | — | — | — | — | — | |
| Video VQ-VAEResolution=256 x 2562021.03 | 129.85 | — | — | — | — | — | — | |
| Video TransformerResolution=64 x 642021.03 | 170 | — | — | — | — | — | — | |
| Video Transformerpredicted frames=11, conditioned frames=5, frame skipping=false2020.03 | 170 | — | — | — | — | — | — | |
| Video Transformer2022.04 | 170 | — | — | — | — | — | — | |
| LVTnumber of codebooks (nc)=4, subscaling type=Single Frame2020.06 | 224.73 | 2.14 | — | — | — | — | — | |
| Baseline2020.06 | 271 | — | — | — | — | — | — | |
| Video Transformer2020.06 | 1,705 | 1.19 | — | — | — | — | — | |
| MAGIType=AR, VAE=Omni2025.01 | — | — | — | — | — | — | 11.5 | |
| MAGVITType=NAR, VAE=MAGVIT2025.01 | — | — | — | — | — | — | 9.9 | |
| MAGVIT-v2Type=NAR, VAE=MAGVIT-v22025.01 | — | — | — | — | — | — | 4.3 | |
| OmniType=AR, VAE=Omni2025.01 | — | — | — | — | — | — | 32.9 | |
| PhenakiType=AR, VAE=VQVAE2025.01 | — | — | — | — | — | — | 36.4 | |
| RINType=NAR2025.01 | — | — | — | — | — | — | 10.8 | |
| Video DiffusionType=NAR2025.01 | — | — | — | — | — | — | 16.2 | |
| ViVQVAEType=AR, VAE=VQVAE2025.01 | — | — | — | — | — | — | 64.3 |