Extreme weather forecasting on WEATHER-5K 2023 (test)
0Temperature 99.5th Percentile (SEDI %)STID
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| STIDType=MLP-based, Input Length=48, Prediction Length=1202024.06 | 0 | 1.4 | 0 | 2.3 | 0.1 | 0.1 | 0 | 0 | 0 | 0.2 | |
| MTGNNType=GNN-based, Input Length=48, Prediction Length=1202024.06 | 3.1 | 9.9 | 2.9 | 9 | 0.1 | 4 | 0.08 | 0.5 | 1.1 | 3.9 | |
| DLinearType=MLP-based, Input Length=48, Prediction Length=1202024.06 | 5.8 | 18.8 | 3.2 | 19.9 | 0.3 | 5.1 | 0.13 | 1.7 | 2.8 | 17.5 | |
| SparseTSFType=MLP-based, Input Length=48, Prediction Length=1202024.06 | 6.1 | 41.1 | 9.7 | 43.4 | 1.1 | 10.5 | 0.13 | 3.7 | 7.5 | 31.5 | |
| PyraformerType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 10.7 | 54.8 | 7.2 | 40.1 | 0.6 | 7.2 | 0.06 | 1.1 | 10.5 | 26.2 | |
| PatchTSTType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 10.9 | 50.8 | 8.9 | 42.4 | 0.5 | 8.9 | 0.1 | 2.2 | 13.5 | 36.7 | |
| CorrformerType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 10.9 | 48.9 | 8.4 | 39.9 | 1.7 | 8.4 | 0.12 | 0.9 | 8.9 | 30.9 | |
| InformerType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 11.8 | 49.5 | 9.2 | 39.2 | 2.1 | 6.7 | 0.12 | 2.9 | 9.8 | 35.7 | |
| FEDformerType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 11.9 | 50.9 | 9.9 | 40.7 | 2.9 | 9.5 | 0.08 | 0.7 | 7.5 | 21.4 | |
| TimeMixerType=MLP-based, Input Length=48, Prediction Length=1202024.06 | 11.9 | 53.7 | 8.9 | 42.7 | 1.1 | 8.7 | 0.01 | 1 | 11.7 | 33 | |
| WPMixerType=MLP-based, Input Length=48, Prediction Length=1202024.06 | 11.9 | 53.1 | 8.2 | 42.3 | 0.8 | 8.4 | 0.01 | 1 | 10.6 | 33.1 | |
| AutoformerType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 12.4 | 52.1 | 8.3 | 38.9 | 0.3 | 7.8 | 0.13 | 1.6 | 10.4 | 32.1 | |
| iTransformerType=Transformer-based, Input Length=48, Prediction Length=1202024.06 | 14.1 | 55 | 10.4 | 44.8 | 1.3 | 10.3 | 0.14 | 2.3 | 15.9 | 37.5 | |
| TimerType=LTMs, Input Length=48, Prediction Length=1202024.06 | 14.2 | 52.3 | 8.4 | 41 | 1.2 | 9.1 | 0.13 | 2.8 | 9.4 | 32.6 | |
| ChronosType=LTMs, Input Length=48, Prediction Length=1202024.06 | 26.2 | 59.5 | 16.9 | 47.1 | 6.3 | 18 | 2.51 | 9.6 | 18.7 | 41.3 | |
| PhysicsFormerType=Physics-based, Input Length=48, Prediction Length=1202024.06 | 30.6 | 77.7 | 20.4 | 61.6 | 7.8 | 28 | 5.01 | 21.2 | 62.6 | 66 | |
| ECMWF-HRESType=NWP (Operational), Input Length=48, Prediction Length=1202024.06 | 37.4 | 82.6 | 35.4 | 76.4 | 10.2 | 40.8 | 13.1 | 45.4 | 77.5 | 89.7 |