Point Forecasting on fev-bench v0.7.0
86.9Win RateChronos-2
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Chronos-2Runtime (s)=0.8, Leak. (%)=0, # fails=02026.05 | 86.9 | 35.5 | |
| TiRexRuntime (s)=0.2, Leak. (%)=1, # fails=02026.05 | 76.9 | 30 | |
| TimesFM-2.5Runtime (s)=1.9, Leak. (%)=10, # fails=02026.05 | 74.9 | 30.2 | |
| TabPFN-TS-3Runtime (s)=234.6, Leak. (%)=0, # fails=02026.05 | 69.8 | 30.6 | |
| Toto-1.0Runtime (s)=22.1, Leak. (%)=8, # fails=02026.05 | 66.3 | 28.2 | |
| Moirai-2.0Runtime (s)=0.3, Leak. (%)=28, # fails=02026.05 | 61.4 | 27.3 | |
| Chronos-BoltRuntime (s)=0.2, Leak. (%)=0, # fails=02026.05 | 60.7 | 26.5 | |
| TabPFN-v2-TSRuntime (s)=88.9, Leak. (%)=0, # fails=22026.05 | 58.5 | 27.6 | |
| CatBoost (Recursive)Runtime (s)=0.3, Leak. (%)=0, # fails=02026.05 | 54 | 23.7 | |
| Sundial-BaseRuntime (s)=8.0, Leak. (%)=1, # fails=02026.05 | 53.4 | 24.7 | |
| LightGBM (Recursive)Runtime (s)=0.3, Leak. (%)=0, # fails=02026.05 | 50.3 | 22.4 | |
| Stat. EnsembleRuntime (s)=148.6, Leak. (%)=0, # fails=112026.05 | 46.7 | 15.7 | |
| AutoARIMARuntime (s)=19.5, Leak. (%)=0, # fails=102026.05 | 36 | 11.2 | |
| AutoThetaRuntime (s)=3.3, Leak. (%)=0, # fails=02026.05 | 34.2 | 11 | |
| AutoETSRuntime (s)=3.5, Leak. (%)=0, # fails=32026.05 | 33.5 | 2.3 | |
| TabICL-v2†Runtime (s)=64.7, Leak. (%)=0, # fails=02026.05 | 33.2 | 7 | |
| Seasonal NaiveRuntime (s)=0.5, Leak. (%)=0, # fails=02026.05 | 20 | 0 | |
| NaiveRuntime (s)=0.5, Leak. (%)=0, # fails=02026.05 | 18 | -16.7 | |
| DriftRuntime (s)=0.5, Leak. (%)=0, # fails=02026.05 | 15.3 | -18.1 |