Time Series Anomaly Detection on SMAP
96.61F1 ScoreMEMTO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MEMTO2023.12 | 96.61 | 93.76 | 99.63 | — | — | |
| Anomaly Transformer2023.12 | 96.15 | 93.96 | 98.45 | — | — | |
| THOC2023.12 | 90.68 | 92.06 | 89.34 | — | — | |
| MTAD-GATModel Category=Forecasting based2020.09 | 90.13 | 89.06 | 91.23 | — | — | |
| TranADTraining=Complete training data2022.01 | 89.15 | 80.43 | 99.99 | 0.9921 | — | |
| InterFusion2023.12 | 89.14 | 89.77 | 88.52 | — | — | |
| LSTM-NDTModel Category=Forecasting based2020.09 | 89.05 | 89.65 | 88.46 | — | — | |
| DAGMMTraining=Complete training data2022.01 | 88.88 | 80.69 | 98.91 | 0.9885 | — | |
| MTAD-GATTraining=Complete training data2022.01 | 88.8 | 79.91 | 99.91 | 0.9844 | — | |
| CAE-MTraining=Complete training data2022.01 | 88.27 | 81.93 | 95.67 | 0.9901 | — | |
| OmniAnomalyTraining=Complete training data2022.01 | 87.28 | 81.3 | 94.19 | 0.9889 | — | |
| OmniAnomaly2023.12 | 86.92 | 92.49 | 81.99 | — | — | |
| MSCREDTraining=Complete training data2022.01 | 86.64 | 81.75 | 92.16 | 0.9821 | — | |
| MAD-GANTraining=Complete training data2022.01 | 86.54 | 81.57 | 92.16 | 0.9891 | — | |
| GDNTraining=Complete training data2022.01 | 85.18 | 74.8 | 98.91 | 0.9864 | — | |
| OmniAnomalyModel Category=Reconstruction based2020.09 | 84.34 | 74.16 | 97.76 | — | — | |
| USADTraining=Complete training data2022.01 | 84.19 | 74.8 | 96.27 | 0.989 | — | |
| MMPCACD2023.12 | 81.73 | 88.61 | 75.84 | — | — | |
| MAD-GANModel Category=Reconstruction based2020.09 | 81.31 | 80.49 | 82.14 | — | — | |
| KitNetModel Category=Reconstruction based2020.09 | 80.14 | 77.25 | 83.27 | — | — | |
| LSTM-NDTTraining=Complete training data2022.01 | 78.79 | 85.23 | 73.26 | 0.8602 | — | |
| LSTM-VAE2023.12 | 78.1 | 92.2 | 67.75 | — | — | |
| GAN-LiModel Category=Reconstruction based2020.09 | 75.79 | 67.1 | 87.06 | — | — | |
| LSTM-VAEModel Category=Reconstruction based2020.09 | 72.98 | 85.51 | 63.66 | — | — | |
| PLDATSAD Model=TcnED2024.10 | 71.1 | — | — | — | — | |
| DAGMMModel Category=Forecasting based2020.09 | 71.05 | 58.45 | 90.58 | — | — | |
| ORIGTSAD Model=TcnED2024.10 | 70.7 | — | — | — | — | |
| LOSSTSAD Model=TcnED2024.10 | 70.6 | — | — | — | — | |
| ORIGTSAD Model=TranAD2024.10 | 70.5 | — | — | — | — | |
| PITSAD Model=TranAD2024.10 | 70.5 | — | — | — | — | |
| LOSSTSAD Model=TranAD2024.10 | 70.5 | — | — | — | — | |
| PITSAD Model=TcnED2024.10 | 70.2 | — | — | — | — | |
| PLDATSAD Model=TranAD2024.10 | 70.1 | — | — | — | — | |
| PLDATSAD Model=NCAD2024.10 | 70 | — | — | — | — | |
| LOSSTSAD Model=NCAD2024.10 | 69.9 | — | — | — | — | |
| ORIGTSAD Model=NCAD2024.10 | 69.8 | — | — | — | — | |
| PITSAD Model=NCAD2024.10 | 69.7 | — | — | — | — | |
| BeatGAN2023.12 | 69.61 | 92.38 | 55.85 | — | — | |
| Deep-SVDD2023.12 | 69.04 | 89.93 | 56.02 | — | — | |
| DAGMM2023.12 | 68.51 | 86.45 | 56.73 | — | — | |
| LOF2023.12 | 57.6 | 58.93 | 56.33 | — | — | |
| OC-SVM2023.12 | 56.34 | 53.85 | 59.07 | — | — | |
| Isolation Forest2023.12 | 55.53 | 52.39 | 59.07 | — | — | |
| TimeLAVATime (s)=0.722026.06 | 54 | — | — | 0.74 | — | |
| PLDATSAD Model=NeuTral2024.10 | 49.7 | — | — | — | — | |
| PITSAD Model=NeuTral2024.10 | 47.8 | — | — | — | — | |
| LOSSTSAD Model=NeuTral2024.10 | 47.6 | — | — | — | — | |
| ORIGTSAD Model=NeuTral2024.10 | 47.1 | — | — | — | — | |
| DCdetectorTime (s)=194.522026.06 | 35 | — | — | 0.67 | — | |
| TimeInfTime (s)=10.592026.06 | 34 | — | — | 0.73 | — | |
| Isolation ForestTime (s)=0.142026.06 | 33 | — | — | 0.67 | — | |
| LSTMTime (s)=245.522026.06 | 31 | — | — | 0.55 | — | |
| MERLINTraining=Complete training data2022.01 | 27.25 | 15.77 | 99.99 | 0.7426 | — | |
| LWCVTime (s)=354.302026.06 | 26 | — | — | 0.63 | — | |
| ModernTCNTime (s)=650.702026.06 | 12 | — | — | 0.46 | — | |
| CATCHTime (s)=1314.042026.06 | 6 | — | — | 0.5 | — | |
| Anomaly TransformerTime (s)=51.242026.06 | 4 | — | — | 0.49 | — | |
| AE2026.02 | — | — | — | 0.4687 | 13.66 | |
| AT2026.02 | — | — | — | 0.4571 | 12.39 | |
| CAE2026.02 | — | — | — | 0.4212 | 11.44 | |
| CrossAD2026.02 | — | — | — | 0.5779 | 14.43 | |
| DAGMM2026.02 | — | — | — | 0.5599 | 13.49 | |
| DC2026.02 | — | — | — | 0.4444 | 11.49 | |
| GPT4TS2026.02 | — | — | — | 0.5449 | 12.89 | |
| HBOS2026.02 | — | — | — | 0.562 | 13.88 | |
| IForest2026.02 | — | — | — | 0.496 | 13.15 | |
| LEFT2026.02 | — | — | — | 0.6562 | 17.26 | |
| LODA2026.02 | — | — | — | 0.3973 | 10.17 | |
| LOF2026.02 | — | — | — | 0.5673 | 14.09 | |
| LSTM2026.02 | — | — | — | 0.5329 | 13.99 | |
| ModernTCN2026.02 | — | — | — | 0.547 | 13.95 | |
| MtsCID2026.02 | — | — | — | 0.426 | 11.77 | |
| OCSVM2026.02 | — | — | — | 0.4185 | 11.33 | |
| Omni2026.02 | — | — | — | 0.4743 | 12.39 | |
| PCA2026.02 | — | — | — | 0.409 | 11.44 | |
| TimeMixer2026.02 | — | — | — | 0.5552 | 13.71 | |
| TimesNet2026.02 | — | — | — | 0.5495 | 13.52 |