Video Prediction on Moving MNIST 10000 sequences (val)
12.4MSEPredFormer (Quadruplet-TSST)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PredFormer (Quadruplet-TSST)Paras (M)=25.3, Flops (G)=16.5, FPS=302, Memory (MB)=1182024.10 | 12.4 | 44.6 | 0.973 | |
| PredFormer (Quadruplet-STTS)Paras (M)=25.3, Flops (G)=16.4, FPS=322, Memory (MB)=1182024.10 | 12.4 | 44.9 | 0.973 | |
| PredFormer (Binary-TS)Paras (M)=25.3, Flops (G)=16.5, FPS=301, Memory (MB)=117.42024.10 | 12.8 | 46.1 | 0.972 | |
| PredFormer (Triplet-STS)Paras (M)=25.3, Flops (G)=16.5, FPS=321, Memory (MB)=1182024.10 | 13.1 | 46.7 | 0.972 | |
| PredFormer (Binary-ST)Paras (M)=25.3, Flops (G)=16.5, FPS=316, Memory (MB)=117.42024.10 | 13.4 | 47.1 | 0.971 | |
| PredFormer (Triplet-TST)Paras (M)=25.3, Flops (G)=16.4, FPS=312, Memory (MB)=1182024.10 | 13.4 | 47.2 | 0.971 | |
| PredFormer (Fac-T-S)Paras (M)=25.3, Flops (G)=16.5, FPS=370, Memory (MB)=117.42024.10 | 16.9 | 55.8 | 0.963 | |
| PredFormer (Full Attention)Paras (M)=25.3, Flops (G)=21.2, FPS=254, Memory (MB)=135.92024.10 | 17.3 | 56 | 0.962 | |
| SwinLSTMParas (M)=20.2, Flops (G)=69.9, FPS=62, Memory (MB)=96.42024.10 | 17.7 | — | 0.962 | |
| OpenSTL_SwinParas (M)=46.1, Flops (G)=16.9, FPS=290, Memory (MB)=331.92024.10 | 18.3 | 59 | 0.96 | |
| OpenSTL_ViTParas (M)=46.1, Flops (G)=16.9, FPS=290, Memory (MB)=331.82024.10 | 19 | 60.8 | 0.955 | |
| TAUParas (M)=44.7, Flops (G)=16, FPS=283, Memory (MB)=322.92024.10 | 19.8 | 60.3 | 0.957 | |
| PredFormer (Fac-S-T)Paras (M)=25.3, Flops (G)=16.5, FPS=368, Memory (MB)=117.42024.10 | 20.6 | 63.5 | 0.955 | |
| SimVPParas (M)=58, Flops (G)=19.4, FPS=209, Memory (MB)=284.72024.10 | 23.8 | 68.9 | 0.948 | |
| PhyDNetParas (M)=3.1, Flops (G)=15.3, FPS=182, Memory (MB)=149.52024.10 | 24.4 | 70.3 | 0.947 | |
| MAUParas (M)=4.5, Flops (G)=17.8, FPS=201, Memory (MB)=35.42024.10 | 27.6 | 86.5 | 0.937 | |
| E3D-LSTMParas (M)=51, Flops (G)=298.9, FPS=18, Memory (MB)=270.12024.10 | 41.3 | 86.4 | 0.91 | |
| MIMParas (M)=38, Flops (G)=179.2, FPS=37, Memory (MB)=160.62024.10 | 44.2 | 101.1 | 0.91 | |
| PredRNN++Paras (M)=38.6, Flops (G)=171.7, FPS=38, Memory (MB)=164.12024.10 | 46.5 | 106.8 | 0.898 | |
| PredRNNv2Paras (M)=24.6, Flops (G)=708, FPS=24, Memory (MB)=1092024.10 | 48.4 | 129.8 | 0.891 | |
| PredRNNParas (M)=23.8, Flops (G)=116, FPS=54, Memory (MB)=107.62024.10 | 56.8 | 126.1 | 0.867 | |
| ConvLSTMParas (M)=15, Flops (G)=56.8, FPS=113, Memory (MB)=68.82024.10 | 103.3 | 182.9 | 0.707 |