Time Series Forecasting on fev-bench
91.7Average Win RateChronos-2
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Chronos-2Runtime (s)=0.8, Leak. (%)=0, # fails=02026.05 | 91.7 | 47.3 | |
| TiRexRuntime (s)=0.2, Leak. (%)=1, # fails=02026.05 | 83.4 | 42.6 | |
| iAmTimeMedian runtime (s)=4.8, Leakage (%)=0, protocol=Zero-shot2026.03 | 81.3 | 51.9 | |
| Chronos-2Median runtime (s)=2.7, Leakage (%)=02026.03 | 79.7 | 51.5 | |
| TimesFM-2.5Runtime (s)=1.9, Leak. (%)=10, # fails=02026.05 | 78.6 | 42.2 | |
| TabPFN-TS-3Runtime (s)=234.6, Leak. (%)=0, # fails=02026.05 | 73.6 | 43.1 | |
| Toto-1.0Runtime (s)=22.1, Leak. (%)=8, # fails=02026.05 | 71.6 | 40.7 | |
| TimesFM-2.5Median runtime (s)=16.9, Leakage (%)=102026.03 | 69 | 50.8 | |
| TiRexMedian runtime (s)=1.4, Leakage (%)=12026.03 | 66.2 | 46.7 | |
| Moirai-2.0Runtime (s)=0.3, Leak. (%)=28, # fails=02026.05 | 66.2 | 39.3 | |
| Chronos-BoltRuntime (s)=0.2, Leak. (%)=0, # fails=02026.05 | 66.2 | 38.9 | |
| TabPFN-v2-TSRuntime (s)=88.9, Leak. (%)=0, # fails=22026.05 | 64.1 | 39.6 | |
| Toto-1.0Median runtime (s)=90.7, Leakage (%)=82026.03 | 57.3 | 45.3 | |
| TabICL-v2Runtime (s)=64.7, Leak. (%)=0, # fails=02026.05 | 53.8 | 30.8 | |
| TabPFN-TSMedian runtime (s)=305.5, Leakage (%)=02026.03 | 52.4 | 45.8 | |
| Moirai-2.0Median runtime (s)=2.5, Leakage (%)=282026.03 | 50.9 | 44.9 | |
| Sundial-BaseRuntime (s)=8.0, Leak. (%)=1, # fails=02026.05 | 47.1 | 33.4 | |
| Chronos-Bolt BaseMedian runtime (s)=1.0, Leakage (%)=02026.03 | 45.2 | 43.2 | |
| Stat. EnsembleRuntime (s)=148.6, Leak. (%)=0, # fails=112026.05 | 43.8 | 20.2 | |
| Stat. EnsembleMedian runtime (s)=690.6, Leakage (%)=02026.03 | 28.3 | 21.8 | |
| AutoARIMAMedian runtime (s)=186.8, Leakage (%)=02026.03 | 25.4 | 23.4 | |
| AutoETSMedian runtime (s)=17.0, Leakage (%)=02026.03 | 19.1 | -27 | |
| Seasonal NaiveRuntime (s)=0.5, Leak. (%)=0, # fails=02026.05 | 19.1 | 0 | |
| AutoThetaMedian runtime (s)=9.3, Leakage (%)=02026.03 | 13.3 | 7.8 | |
| Seasonal NaiveMedian runtime (s)=2.3, Leakage (%)=02026.03 | 8.3 | 0 |