Forecasting on Weather (MSE, MAE, Relative Improvement)
0.086MSECrossformer
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CrossformerBackbone=Crossformer, Forecasting Horizon=24, LIFT enhancement=false2024.01 | 0.086 | 0.126 | — | |
| Crossformer + LIFTBackbone=Crossformer, Forecasting Horizon=24, LIFT enhancement=true2024.01 | 0.086 | 0.126 | 4.7 | |
| PatchTST + LIFTBackbone=PatchTST, Forecasting Horizon=24, LIFT enhancement=true2024.01 | 0.089 | 0.119 | 4.7 | |
| DLinear + LIFTBackbone=DLinear, Forecasting Horizon=24, LIFT enhancement=true2024.01 | 0.09 | 0.125 | 4.7 | |
| MTGNNBackbone=MTGNN, Forecasting Horizon=24, LIFT enhancement=false2024.01 | 0.09 | 0.128 | — | |
| MTGNN + LIFTBackbone=MTGNN, Forecasting Horizon=24, LIFT enhancement=true2024.01 | 0.09 | 0.126 | 4.7 | |
| PatchTSTBackbone=PatchTST, Forecasting Horizon=24, LIFT enhancement=false2024.01 | 0.091 | 0.122 | — | |
| DLinearBackbone=DLinear, Forecasting Horizon=24, LIFT enhancement=false2024.01 | 0.104 | 0.152 | — | |
| PatchFormerH=96, Zero-shot=true2026.01 | 0.178 | — | — | |
| PatchTSTH=96, Zero-shot=true2026.01 | 0.196 | — | — | |
| MOMENTH=96, Zero-shot=true2026.01 | 0.205 | — | — | |
| TimeGPTH=96, Zero-shot=true2026.01 | 0.214 | — | — | |
| TimeBlocksEvaluation Protocol=Continual Forecasting, Coreset Strategy=StreamCore 5%, Calibration Steps=102026.06 | 0.22 | — | — | |
| TimeBlocksEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.225 | — | — | |
| ChronosH=96, Zero-shot=true2026.01 | 0.228 | — | — | |
| TTMEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.232 | — | — | |
| TimeMixerEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.233 | — | — | |
| PatchTSTEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.24 | — | — | |
| LSTMH=96, Zero-shot=true2026.01 | 0.247 | — | — | |
| Lag-LlamaEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.248 | — | — | |
| PatchFormerH=336, Zero-shot=true2026.01 | 0.251 | — | — | |
| TimesNetEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.256 | — | — | |
| PatchTSTH=336, Zero-shot=true2026.01 | 0.284 | — | — | |
| MOMENTH=336, Zero-shot=true2026.01 | 0.291 | — | — | |
| ARIMAH=96, Zero-shot=true2026.01 | 0.298 | — | — | |
| TimeGPTH=336, Zero-shot=true2026.01 | 0.302 | — | — | |
| ChronosH=336, Zero-shot=true2026.01 | 0.318 | — | — | |
| AutoformerEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.336 | — | — | |
| LSTMH=336, Zero-shot=true2026.01 | 0.351 | — | — | |
| ARIMAH=336, Zero-shot=true2026.01 | 0.412 | — | — | |
| MomentEvaluation Protocol=Continual Forecasting, Coreset Strategy=Random 5%, Calibration Steps=102026.06 | 0.723 | — | — |