# Multivariate Time-series Forecasting on ETTm1 15-minute (test)

Source: [Multivariate Time-series Forecasting on ETTm1 15-minute (test)](<https://www.sota2.com/research/sota/multivariate-time-series-forecasting-on-ettm1-15-minute-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:50:38.816Z

Evaluation of models performing Multivariate Time-series Forecasting specifically on the 15-minute granularity test split of the ETTm1 dataset, typically assessed using MSE and MAE.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multivariate Time-series Forecasting |
| Dataset (including any stated split) | ETTm1 15-minute (test) |
| Metric | MSE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MSE](<https://www.sota2.com/research/sota/multivariate-time-series-forecasting-on-ettm1-15-minute-test.md?metric=MSE>): Lower is better; unit: SCALAR.

- [MAE](<https://www.sota2.com/research/sota/multivariate-time-series-forecasting-on-ettm1-15-minute-test.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MSE | Result date | Report paper |
| --- | --- | --- | --- |
| Informer | 0.323 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Autoformer | 0.383 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LogTrans | 0.419 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Autoformer | 0.454 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Autoformer | 0.481 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Informer | 0.494 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LogTrans | 0.507 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Autoformer | 0.606 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTMa | 0.621 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Autoformer | 0.634 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Informer | 0.678 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Reformer | 0.724 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LogTrans | 0.768 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Informer | 1.056 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Reformer | 1.098 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Informer | 1.192 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTNet | 1.257 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTMa | 1.339 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTMa | 1.392 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Reformer | 1.433 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LogTrans | 1.462 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LogTrans | 1.669 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTMa | 1.74 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Reformer | 1.82 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTNet | 1.917 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTNet | 1.968 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTNet | 1.999 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| Reformer | 2.187 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTMa | 2.736 | Not recorded | 68fa6b9a1e209131cea2f3a3 |
| LSTNet | 2.762 | Not recorded | 68fa6b9a1e209131cea2f3a3 |

### Informer

MSE: 0.323. Result ID: 698e993dffc3901de09f0262.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa699f1e209131cea23263.md>)

[Implementation](<https://github.com/zhouhaoyi/Informer2020>)

Recorded evaluation configuration: {"Predicted Length":"24"}. This record does not assert independent reproduction.

### Autoformer

MSE: 0.383. Result ID: 698e993dffc3901de09f025d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Implementation](<https://github.com/thuml/Autoformer>)

Recorded evaluation configuration: {"Predicted Length":"24"}. This record does not assert independent reproduction.

### LogTrans

MSE: 0.419. Result ID: 698e993dffc3901de09f0267.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66e71e209131cea1309f.md>)

Recorded evaluation configuration: {"Predicted Length":"24"}. This record does not assert independent reproduction.

### Autoformer

MSE: 0.454. Result ID: 698e993dffc3901de09f025e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Implementation](<https://github.com/thuml/Autoformer>)

Recorded evaluation configuration: {"Predicted Length":"48"}. This record does not assert independent reproduction.

### Autoformer

MSE: 0.481. Result ID: 698e993dffc3901de09f025f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Implementation](<https://github.com/thuml/Autoformer>)

Recorded evaluation configuration: {"Predicted Length":"96"}. This record does not assert independent reproduction.

### Informer

MSE: 0.494. Result ID: 698e993dffc3901de09f0263.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa699f1e209131cea23263.md>)

[Implementation](<https://github.com/zhouhaoyi/Informer2020>)

Recorded evaluation configuration: {"Predicted Length":"48"}. This record does not assert independent reproduction.

### LogTrans

MSE: 0.507. Result ID: 698e993dffc3901de09f0268.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66e71e209131cea1309f.md>)

Recorded evaluation configuration: {"Predicted Length":"48"}. This record does not assert independent reproduction.

### Autoformer

MSE: 0.606. Result ID: 698e993dffc3901de09f0261.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Implementation](<https://github.com/thuml/Autoformer>)

Recorded evaluation configuration: {"Predicted Length":"672"}. This record does not assert independent reproduction.

### LSTMa

MSE: 0.621. Result ID: 698e993dffc3901de09f0276.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa627b1e209131ce9f9741.md>)

[Implementation](<https://github.com/lisa-groundhog/GroundHog>)

Recorded evaluation configuration: {"Predicted Length":"24"}. This record does not assert independent reproduction.

### Autoformer

MSE: 0.634. Result ID: 698e993dffc3901de09f0260.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Implementation](<https://github.com/thuml/Autoformer>)

Recorded evaluation configuration: {"Predicted Length":"288"}. This record does not assert independent reproduction.

### Informer

MSE: 0.678. Result ID: 698e993dffc3901de09f0264.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa699f1e209131cea23263.md>)

[Implementation](<https://github.com/zhouhaoyi/Informer2020>)

Recorded evaluation configuration: {"Predicted Length":"96"}. This record does not assert independent reproduction.

### Reformer

MSE: 0.724. Result ID: 698e993dffc3901de09f026c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa671b1e209131cea143ed.md>)

[Implementation](<https://github.com/google/trax/tree/master/trax/models/reformer>)

Recorded evaluation configuration: {"Predicted Length":"24"}. This record does not assert independent reproduction.

### LogTrans

MSE: 0.768. Result ID: 698e993dffc3901de09f0269.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66e71e209131cea1309f.md>)

Recorded evaluation configuration: {"Predicted Length":"96"}. This record does not assert independent reproduction.

### Informer

MSE: 1.056. Result ID: 698e993dffc3901de09f0265.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa699f1e209131cea23263.md>)

[Implementation](<https://github.com/zhouhaoyi/Informer2020>)

Recorded evaluation configuration: {"Predicted Length":"288"}. This record does not assert independent reproduction.

### Reformer

MSE: 1.098. Result ID: 698e993dffc3901de09f026d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa671b1e209131cea143ed.md>)

[Implementation](<https://github.com/google/trax/tree/master/trax/models/reformer>)

Recorded evaluation configuration: {"Predicted Length":"48"}. This record does not assert independent reproduction.

### Informer

MSE: 1.192. Result ID: 698e993dffc3901de09f0266.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa699f1e209131cea23263.md>)

[Implementation](<https://github.com/zhouhaoyi/Informer2020>)

Recorded evaluation configuration: {"Predicted Length":"672"}. This record does not assert independent reproduction.

### LSTNet

MSE: 1.257. Result ID: 698e993dffc3901de09f0274.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa643f1e209131cea036e6.md>)

Recorded evaluation configuration: {"Predicted Length":"288"}. This record does not assert independent reproduction.

### LSTMa

MSE: 1.339. Result ID: 698e993dffc3901de09f0278.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa627b1e209131ce9f9741.md>)

[Implementation](<https://github.com/lisa-groundhog/GroundHog>)

Recorded evaluation configuration: {"Predicted Length":"96"}. This record does not assert independent reproduction.

### LSTMa

MSE: 1.392. Result ID: 698e993dffc3901de09f0277.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa627b1e209131ce9f9741.md>)

[Implementation](<https://github.com/lisa-groundhog/GroundHog>)

Recorded evaluation configuration: {"Predicted Length":"48"}. This record does not assert independent reproduction.

### Reformer

MSE: 1.433. Result ID: 698e993dffc3901de09f026e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa671b1e209131cea143ed.md>)

[Implementation](<https://github.com/google/trax/tree/master/trax/models/reformer>)

Recorded evaluation configuration: {"Predicted Length":"96"}. This record does not assert independent reproduction.

### LogTrans

MSE: 1.462. Result ID: 698e993dffc3901de09f026a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66e71e209131cea1309f.md>)

Recorded evaluation configuration: {"Predicted Length":"288"}. This record does not assert independent reproduction.

### LogTrans

MSE: 1.669. Result ID: 698e993dffc3901de09f026b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66e71e209131cea1309f.md>)

Recorded evaluation configuration: {"Predicted Length":"672"}. This record does not assert independent reproduction.

### LSTMa

MSE: 1.74. Result ID: 698e993dffc3901de09f0279.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa627b1e209131ce9f9741.md>)

[Implementation](<https://github.com/lisa-groundhog/GroundHog>)

Recorded evaluation configuration: {"Predicted Length":"288"}. This record does not assert independent reproduction.

### Reformer

MSE: 1.82. Result ID: 698e993dffc3901de09f026f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa671b1e209131cea143ed.md>)

[Implementation](<https://github.com/google/trax/tree/master/trax/models/reformer>)

Recorded evaluation configuration: {"Predicted Length":"288"}. This record does not assert independent reproduction.

### LSTNet

MSE: 1.917. Result ID: 698e993dffc3901de09f0275.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa643f1e209131cea036e6.md>)

Recorded evaluation configuration: {"Predicted Length":"672"}. This record does not assert independent reproduction.

### LSTNet

MSE: 1.968. Result ID: 698e993dffc3901de09f0271.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa643f1e209131cea036e6.md>)

Recorded evaluation configuration: {"Predicted Length":"24"}. This record does not assert independent reproduction.

### LSTNet

MSE: 1.999. Result ID: 698e993dffc3901de09f0272.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa643f1e209131cea036e6.md>)

Recorded evaluation configuration: {"Predicted Length":"48"}. This record does not assert independent reproduction.

### Reformer

MSE: 2.187. Result ID: 698e993dffc3901de09f0270.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa671b1e209131cea143ed.md>)

[Implementation](<https://github.com/google/trax/tree/master/trax/models/reformer>)

Recorded evaluation configuration: {"Predicted Length":"672"}. This record does not assert independent reproduction.

### LSTMa

MSE: 2.736. Result ID: 698e993dffc3901de09f027a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa627b1e209131ce9f9741.md>)

[Implementation](<https://github.com/lisa-groundhog/GroundHog>)

Recorded evaluation configuration: {"Predicted Length":"672"}. This record does not assert independent reproduction.

### LSTNet

MSE: 2.762. Result ID: 698e993dffc3901de09f0273.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6b9a1e209131cea2f3a3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa643f1e209131cea036e6.md>)

Recorded evaluation configuration: {"Predicted Length":"96"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
