Precipitation Forecasting on SEVIR (test)
2.9371MSEIAM4VP
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| IAM4VP#Param. (M)=34.7, GFLOPS=3922023.03 | 2.9371 | 46.07 | 34.3 | 77.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Earthformer#Param. (M)=15.1, GFLOPS=2572022.07 | 3.6702 | — | 31.26 | 76.82 | 14.8 | 27.48 | 42.31 | 68.86 | 62.66 | 43.59 | 2.5112 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Earthformer#Param. (M)=7.6, GFLOPS=2572023.03 | 3.6957 | 44.19 | 32.32 | 75.13 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Earthformer#Param. (M)=15.1, GFLOPS=257, global vectors=true2022.07 | 3.6957 | 44.19 | 32.32 | 75.13 | 17.91 | 28.48 | 42.71 | 68.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Earthformer#Param. (M)=13.1, GFLOPS=257, global vectors=false2022.07 | 3.7002 | 43.56 | 31.38 | 76.37 | 15.72 | 27.16 | 42.14 | 68.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Earthformer w/o global#Param. (M)=13.1, GFLOPS=2572022.07 | 3.7006 | — | 30.86 | 76.71 | 14.29 | 26.43 | 42.15 | 68.85 | 62.57 | 43.21 | 2.5306 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConvLSTM#Param. (M)=14, GFLOPS=5272023.03 | 3.7532 | 41.85 | 21.57 | 74.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConvLSTM#Param. (M)=14.0, GFLOPS=5272022.07 | 3.7532 | — | 28.29 | 75.55 | 10.71 | 22.75 | 41.55 | 68.73 | 61.94 | 41.26 | 2.5898 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConvLSTM#Param. (M)=14, GFLOPS=5272022.07 | 3.7532 | 41.85 | 29.28 | 75.69 | 12.88 | 24.82 | 40.52 | 67.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PredRNN#Param. (M)=23.8, GFLOPS=3282023.03 | 3.9014 | 40.8 | 29.28 | 75.69 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PredRNN#Param. (M)=46.6, GFLOPS=3282022.07 | 3.9014 | — | 27.18 | 75.44 | 11.64 | 22.46 | 38.73 | 67.44 | 60.54 | 40.48 | 2.6963 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PredRNN#Param. (M)=46.6, GFLOPS=3282022.07 | 3.9014 | 40.8 | 27.67 | 75.07 | 13.12 | 23.24 | 38.58 | 67.13 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Rainformer#Param. (M)=19.2, GFLOPS=1702023.03 | 4.0272 | 36.61 | 26.75 | 75.73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Rainformer#Param. (M)=184.0, GFLOPS=1702022.07 | 4.0272 | — | 20.87 | 73.08 | 7.45 | 15.8 | 33.97 | 65.99 | 57.68 | 36.19 | 3.0711 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Rainformer#Param. (M)=184, GFLOPS=1702022.07 | 4.0272 | 36.61 | 21.67 | 72.77 | 8.31 | 16.7 | 34.38 | 65.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UNet#Param. (M)=16.6, GFLOPS=332023.03 | 4.1119 | 35.93 | 12.78 | 60.47 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UNet#Param. (M)=16.6, GFLOPS=332022.07 | 4.1119 | — | 18.87 | 74.44 | 5.21 | 13.64 | 30.32 | 65.42 | 56.73 | 34.65 | 2.7633 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| UNet#Param. (M)=16.6, GFLOPS=332022.07 | 4.1119 | 35.93 | 21.57 | 74.41 | 5.77 | 15.8 | 32.74 | 65.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| E3D-LSTM#Param. (M)=12.9, GFLOPS=5232023.03 | 4.1702 | 40.38 | 27.08 | 70.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| E3D-LSTM#Param. (M)=35.6, GFLOPS=5232022.07 | 4.1702 | — | 26.37 | 75.91 | 11.25 | 22.18 | 38.47 | 66.74 | 60.37 | 40.15 | 2.5023 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| E3D-LSTM#Param. (M)=35.6, GFLOPS=5232022.07 | 4.1702 | 40.38 | 26.75 | 75.73 | 12.39 | 22.7 | 38.25 | 66.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PhyDNet#Param. (M)=3.1, GFLOPS=7012023.03 | 4.8165 | 39.4 | 27.67 | 75.07 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PhyDNet#Param. (M)=13.7, GFLOPS=7012022.07 | 4.8165 | — | 25.83 | 71.76 | 10.41 | 21.23 | 37.55 | 66.27 | 58.53 | 38.84 | 3.1896 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PhyDNet#Param. (M)=13.7, GFLOPS=7012022.07 | 4.8165 | 39.4 | 27.08 | 70.59 | 12.88 | 23.09 | 37.2 | 65.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Persistence2022.07 | 11.5283 | — | 13.74 | 61.09 | 5.75 | 10.56 | 22.59 | 47.96 | 43.86 | 26.95 | 4.4349 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Persistence2022.07 | 11.5338 | 26.13 | 12.78 | 60.47 | 5.26 | 9.69 | 21.55 | 47.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PredRNN + FBType=Ours, Params=25.02M, FLOPS=0.153T2026.06 | 49.6812 | — | — | — | — | — | — | — | — | — | 198.773 | — | — | — | — | — | 69.99 | — | — | — | — | — | — | — | — | — | 45.38 | 38.95 | 32.51 | |
| ConvLSTMType=Recurrent-based, Params=15.08M, FLOPS=71.735G2026.06 | 52.3914 | — | — | — | — | — | — | — | — | — | 203.373 | — | — | — | — | — | 69.38 | — | — | — | — | — | — | — | — | — | 44.69 | 38.42 | 31.82 | |
| PredRNNpp + FBType=Ours, Params=39.76M, FLOPS=0.224T2026.06 | 52.4572 | — | — | — | — | — | — | — | — | — | 201.005 | — | — | — | — | — | 69.93 | — | — | — | — | — | — | — | — | — | 44.99 | 38.63 | 32.3 | |
| MotionRNN + FBType=Ours, Params=28.092M, FLOPS=0.169T2026.06 | 52.5389 | — | — | — | — | — | — | — | — | — | 199.99 | — | — | — | — | — | 69.96 | — | — | — | — | — | — | — | — | — | 45.21 | 39.02 | 32.71 | |
| PredRNNType=Recurrent-based, Params=23.84M, FLOPS=0.146T2026.06 | 53.4924 | — | — | — | — | — | — | — | — | — | 208.914 | — | — | — | — | — | 68.26 | — | — | — | — | — | — | — | — | — | 41.88 | 36.56 | 31.16 | |
| WaSTType=Recurrent-free, Params=28.18M, FLOPS=21.90G2026.06 | 54.3905 | — | — | — | — | — | — | — | — | — | 196.556 | — | — | — | — | — | 71.34 | — | — | — | — | — | — | — | — | — | 45.34 | 38.84 | 32.33 | |
| SwinLSTM*Type=Recurrent-based, Params=0.7M, FLOPS=16.119G2026.06 | 55.5566 | — | — | — | — | — | — | — | — | — | 224.417 | — | — | — | — | — | 64.81 | — | — | — | — | — | — | — | — | — | 40.62 | 33.69 | 27.73 | |
| Predformer-TSSTType=Recurrent-free, Params=25.30M, FLOPS=16.478G2026.06 | 55.8347 | — | — | — | — | — | — | — | — | — | 217.876 | — | — | — | — | — | 66.15 | — | — | — | — | — | — | — | — | — | 40.71 | 34.51 | 28.39 | |
| PredRNN-V2Type=Recurrent-based, Params=23.85M, FLOPS=0.147T2026.06 | 56.1049 | — | — | — | — | — | — | — | — | — | 232.9 | — | — | — | — | — | 62.55 | — | — | — | — | — | — | — | — | — | 39.4 | 32.9 | 25.92 | |
| PredRNN-V2 + FBType=Ours, Params=25.03M, FLOPS=0.154T2026.06 | 56.1824 | — | — | — | — | — | — | — | — | — | 230.289 | — | — | — | — | — | 63 | — | — | — | — | — | — | — | — | — | 39.83 | 33.18 | 26.11 | |
| PyDNetType=Recurrent-based, Params=3.09M, FLOPS=19.361G2026.06 | 57.1866 | — | — | — | — | — | — | — | — | — | 225.926 | — | — | — | — | — | 63.65 | — | — | — | — | — | — | — | — | — | 41.39 | 34.91 | 28.06 | |
| PredRNNppType=Recurrent-based, Params=38.58M, FLOPS=0.217T2026.06 | 57.6933 | — | — | — | — | — | — | — | — | — | 208.626 | — | — | — | — | — | 69.3 | — | — | — | — | — | — | — | — | — | 43.72 | 38.23 | 32.65 | |
| Predformer-STTSType=Recurrent-free, Params=25.30M, FLOPS=16.478G2026.06 | 57.9686 | — | — | — | — | — | — | — | — | — | 224.831 | — | — | — | — | — | 62.8 | — | — | — | — | — | — | — | — | — | 36.81 | 29.69 | 22.79 | |
| MIM + FBType=Ours, Params=38.93M, FLOPS=0.232T2026.06 | 58.1526 | — | — | — | — | — | — | — | — | — | 215.574 | — | — | — | — | — | 67.58 | — | — | — | — | — | — | — | — | — | 41.85 | 36.16 | 30.4 | |
| SimVP-ViTType=Recurrent-free, Params=11.48M, FLOPS=16.99G2026.06 | 59.9962 | — | — | — | — | — | — | — | — | — | 225.128 | — | — | — | — | — | 64.75 | — | — | — | — | — | — | — | — | — | 41.12 | 34.45 | 27.56 | |
| MotionRNNType=Recurrent-based, Params=26.91M, FLOPS=0.163T2026.06 | 60.6225 | — | — | — | — | — | — | — | — | — | 214.475 | — | — | — | — | — | 68.24 | — | — | — | — | — | — | — | — | — | 42.93 | 37.64 | 32.12 | |
| SimVP-gSTAType=Recurrent-free, Params=46.77M, FLOPS=16.53G2026.06 | 60.629 | — | — | — | — | — | — | — | — | — | 206.135 | — | — | — | — | — | 69.38 | — | — | — | — | — | — | — | — | — | 42.99 | 37.42 | 31.63 | |
| TAUType=Recurrent-free, Params=44.65M, FLOPS=15.96G2026.06 | 61.2723 | — | — | — | — | — | — | — | — | — | 208.601 | — | — | — | — | — | 69.24 | — | — | — | — | — | — | — | — | — | 43.15 | 37.48 | 31.68 | |
| MIMType=Recurrent-based, Params=38.34M, FLOPS=0.229T2026.06 | 61.5472 | — | — | — | — | — | — | — | — | — | 219.087 | — | — | — | — | — | 67.53 | — | — | — | — | — | — | — | — | — | 40.94 | 35.59 | 30.03 | |
| MMVPType=Recurrent-free, Params=16.49M, FLOPS=0.12T2026.06 | 62.9421 | — | — | — | — | — | — | — | — | — | 256.71 | — | — | — | — | — | 58.6 | — | — | — | — | — | — | — | — | — | 34.83 | 28.15 | 20.84 | |
| MAUType=Recurrent-based, Params=4.48M, FLOPS=22.47G2026.06 | 64.6087 | — | — | — | — | — | — | — | — | — | 222.4 | — | — | — | — | — | 68.01 | — | — | — | — | — | — | — | — | — | 41.52 | 36.29 | 30.89 | |
| CasCastforecast_steps=122025.11 | — | — | — | — | 19.5 | 28.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 42.7 | 30.9 | 50.1 | 56.7 | — | — | — | |
| ConvLSTM#Param. (M)=14.02023.07 | — | — | — | — | — | — | — | — | — | — | — | 659.7 | 0.0332 | 41.85 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ConvLSTMType=Pred., Loss=MSE2024.10 | — | 39.57 | — | 40.82 | — | — | — | — | — | — | 26.35 | 510.2 | — | — | — | — | 77.3 | 0.3683 | 39.65 | 52.52 | 1.5123 | — | — | — | — | — | — | — | — | |
| ConvLSTMType=Pred., Loss=FACL2024.10 | — | 39.84 | — | 50.73 | — | — | — | — | — | — | 27.6 | 289.5 | — | — | — | — | 76.24 | 0.3508 | 42.95 | 56.4 | 1.2087 | — | — | — | — | — | — | — | — | |
| DGMR#Param. (M)=71.52023.07 | — | — | — | — | — | — | — | — | — | — | — | 485.2 | 0.0435 | 26.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| E3D-LSTM#Param. (M)=35.62023.07 | — | — | — | — | — | — | — | — | — | — | — | 600.1 | 0.0297 | 40.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Earthfarseerforecast_steps=122025.11 | — | — | — | — | 9.7 | 19.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 29.1 | 15.2 | 34.1 | 41.2 | — | — | — | |
| Earthformer#Param. (M)=15.12023.07 | — | — | — | — | — | — | — | — | — | — | — | 690.7 | 0.0304 | 44.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EarthformerType=Pred., Loss=MSE2024.10 | — | 39.99 | — | 39.76 | — | — | — | — | — | — | 26.39 | 947.1 | — | — | — | — | 77.01 | 0.3831 | 39.61 | 53.16 | 1.5363 | — | — | — | — | — | — | — | — | |
| EarthformerType=Pred., Loss=FACL2024.10 | — | 39.82 | — | 47.42 | — | — | — | — | — | — | 28.09 | 384.3 | — | — | — | — | 76.27 | 0.3575 | 41.29 | 52.44 | 1.3736 | — | — | — | — | — | — | — | — | |
| Earthformerforecast_steps=122025.11 | — | — | — | — | 10.9 | 22.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 34.8 | 18 | 35.4 | 34.3 | — | — | — | |
| FlowCastforecast_steps=122025.11 | — | — | — | — | 20.2 | 30.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 44.3 | 31.7 | 42.5 | 48.2 | — | — | — | |
| LDCastType=Gen.2024.10 | — | 30 | — | 44.11 | — | — | — | — | — | — | 40.93 | 163.7 | — | — | — | — | 66.47 | 0.38 | 33.57 | 39.71 | 1.5988 | — | — | — | — | — | — | — | — | |
| LDM#Param. (M)=438.62023.07 | — | — | — | — | — | — | — | — | — | — | — | 133 | 0.028 | 35.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MCVDType=Gen.2024.10 | — | 36.36 | — | 50.17 | — | — | — | — | — | — | 32.88 | 99.6 | — | — | — | — | 73.86 | 0.3239 | 39.81 | 52.3 | 1.3687 | — | — | — | — | — | — | — | — | |
| Persistence2023.07 | — | — | — | — | — | — | — | — | — | — | — | — | 0.0526 | 26.13 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PhyDNet#Param. (M)=13.72023.07 | — | — | — | — | — | — | — | — | — | — | — | 723.2 | 0.0319 | 39.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PreDiff#Param. (M)=220.52023.07 | — | — | — | — | — | — | — | — | — | — | — | 33.05 | 0.0246 | 41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PreDiffforecast_steps=122025.11 | — | — | — | — | 12.8 | 23.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 36.1 | 20.6 | 38.4 | 46.7 | — | — | — | |
| PreDiff-KAknowledge alignment range=∈ [-2στ, 2στ], #Param. (M)=229.42023.07 | — | — | — | — | — | — | — | — | — | — | — | 34.18 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PredRNN#Param. (M)=46.62023.07 | — | — | — | — | — | — | — | — | — | — | — | 663.5 | 0.0306 | 40.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PredRNNLoss=MSE, Resolution=128x1282024.10 | — | 35.53 | — | — | — | — | — | — | — | — | 28.91 | 528.8 | — | — | — | — | 72.38 | 0.3572 | 37.02 | 55.52 | 1.1333 | 41.53 | — | — | — | — | — | — | — | |
| PredRNNLoss=FACL, Resolution=128x1282024.10 | — | 35.53 | — | — | — | — | — | — | — | — | 31.37 | 384.2 | — | — | — | — | 70.83 | 0.3206 | 41.76 | 58.3 | 0.8492 | 53.78 | — | — | — | — | — | — | — | |
| Rainformer#Param. (M)=184.02023.07 | — | — | — | — | — | — | — | — | — | — | — | 760.5 | 0.0357 | 36.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SimVPType=Pred., Loss=MSE2024.10 | — | 39.89 | — | 39.56 | — | — | — | — | — | — | 26.26 | 555.9 | — | — | — | — | 76.43 | 0.3767 | 39.39 | 52.25 | 1.5244 | — | — | — | — | — | — | — | — | |
| SimVPType=Pred., Loss=FACL2024.10 | — | 41 | — | 51.76 | — | — | — | — | — | — | 27.55 | 243.8 | — | — | — | — | 75.51 | 0.3476 | 43.87 | 56.56 | 1.1719 | — | — | — | — | — | — | — | — | |
| SimVPforecast_steps=122025.11 | — | — | — | — | 13.7 | 24.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 36.5 | 22 | 37 | 40.4 | — | — | — | |
| U-Netforecast_steps=122025.11 | — | — | — | — | 12.2 | 20.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 31.4 | 19.3 | 36.6 | 50.8 | — | — | — | |
| UNet#Param. (M)=16.62023.07 | — | — | — | — | — | — | — | — | — | — | — | 753.6 | 0.0353 | 35.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| VideoGPT#Param. (M)=99.62023.07 | — | — | — | — | — | — | — | — | — | — | — | 261.6 | 0.0381 | 36.53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |