Anomaly Detection on SMAP (Precision, Recall, F1)
97.02F1 ScoreDCDetector
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DCDetectorProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 97.02 | 95.63 | 98.92 | |
| Pi-TransformerProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 97.02 | 96.81 | 97.24 | |
| MEMTOEvaluation Protocol=Point-adjustment2025.01 | 96.61 | 93.76 | 99.63 | |
| GDformerEvaluation Protocol=Point-adjustment2025.01 | 96.52 | 95.55 | 97.52 | |
| AnomalyTransProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 96.41 | 93.59 | 99.41 | |
| AnomalyTransEvaluation Protocol=Point-adjustment2025.01 | 96.41 | 93.59 | 99.41 | |
| DCdetectorEvaluation Protocol=Point-adjustment2025.01 | 96.37 | 94.25 | 98.59 | |
| MtsCIDEvaluation Protocol=Point-adjustment2025.01 | 92.95 | 91.76 | 94.17 | |
| THOCProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 90.68 | 92.06 | 89.34 | |
| THOCEvaluation Protocol=Point-adjustment2025.01 | 90.68 | 92.06 | 89.34 | |
| InterFusionProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 89.14 | 89.77 | 88.52 | |
| InterFusionEvaluation Protocol=Point-adjustment2025.01 | 89.14 | 89.77 | 88.52 | |
| OmniAnomalyProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 86.92 | 92.49 | 81.99 | |
| OmniAnomalyEvaluation Protocol=Point-adjustment2025.01 | 86.92 | 92.49 | 81.99 | |
| XCTFormer2026.05 | 86.68 | — | — | |
| TimeBlocks2026.06 | 86.6 | — | — | |
| AnomalyTran2026.06 | 86.5 | — | — | |
| TimesNet2026.06 | 86.4 | — | — | |
| DCdetector2026.06 | 86.2 | — | — | |
| TS-CP2Protocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 85.36 | 87.65 | 83.18 | |
| BOCPDProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 85.24 | 84.65 | 85.85 | |
| LSTMProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 83.39 | 89.41 | 78.13 | |
| PatchTST2026.06 | 81.9 | — | — | |
| MMPCACDProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 81.73 | 88.61 | 75.84 | |
| Autoformer2026.06 | 80.9 | — | — | |
| TimeMixer2026.06 | 80.9 | — | — | |
| LSTM-VAEProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 78.1 | 92.2 | 67.75 | |
| LSTM-VAEEvaluation Protocol=Point-adjustment2025.01 | 78.1 | 92.2 | 67.75 | |
| Lag-Llama2026.06 | 76.7 | — | — | |
| TTM2026.06 | 76.2 | — | — | |
| VI 2D SSM2026.03 | 76.17 | 92.24 | 64.86 | |
| ITADProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 73.85 | 82.42 | 66.89 | |
| Moment2026.06 | 73.5 | — | — | |
| TimeMixer++Publication=ICLR 20252026.05 | 73.1 | — | — | |
| GPT4TS2025.08 | 72.88 | — | — | |
| CL-MPPCAProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 72.88 | 86.13 | 63.16 | |
| GPT4TS2026.03 | 72.88 | 90.6 | 60.95 | |
| SensitiveHUEEvaluation Protocol=Point-adjustment2025.01 | 72.09 | 88.9 | 60.62 | |
| FeDaL2025.08 | 71.7 | — | — | |
| Chimera2026.03 | 71.55 | 93.05 | 58.12 | |
| TimesNetconfig=R2026.03 | 71.52 | 92.52 | 58.29 | |
| TimesNet2025.08 | 71.52 | — | — | |
| TimesNetPublication=ICLR 20232026.05 | 71.52 | — | — | |
| FFTS2025.08 | 71.38 | — | — | |
| ModernTCN2026.03 | 71.26 | 93.17 | 57.69 | |
| MTCN2025.08 | 71.26 | — | — | |
| ModernTCNEvaluation Protocol=Point-adjustment2025.01 | 71.26 | 93.17 | 57.69 | |
| Anomaly*2026.03 | 71.18 | 91.85 | 58.11 | |
| Anomaly2025.08 | 71.18 | — | — | |
| Anomaly TransformerPublication=ICLR 2022, anomaly criterion=only reconstruction error2026.05 | 71.18 | — | — | |
| Autoformer2026.03 | 71.12 | 90.4 | 58.62 | |
| Autoformer_suffix=true2025.08 | 71.12 | — | — | |
| Autoformer2026.03 | 71.12 | 90.4 | 58.62 | |
| AutoformerPublication=NeurIPS 20212026.05 | 71.12 | — | — | |
| Pyraformer2026.03 | 71.09 | 92.54 | 57.71 | |
| Stationary2026.03 | 71.09 | 89.37 | 59.02 | |
| NSformer_suffix=true2025.08 | 71.09 | — | — | |
| Pyraformer_suffix=true2025.08 | 71.09 | — | — | |
| TStationary2026.03 | 71.09 | 89.37 | 59.02 | |
| StationaryPublication=NeurIPS 20222026.05 | 71.09 | — | — | |
| PyraformerPublication=ICLR 20222026.05 | 71.09 | — | — | |
| PatchTST2026.03 | 70.91 | 92.43 | 57.51 | |
| TimesNetconfig=I2026.03 | 70.85 | 91.5 | 57.8 | |
| FedAvg2025.08 | 70.78 | — | — | |
| FEDformer2026.03 | 70.76 | 90.47 | 58.1 | |
| FEDformer_suffix=true2025.08 | 70.76 | — | — | |
| FEDformer2026.03 | 70.76 | 90.47 | 58.1 | |
| FEDformerPublication=ICML 20222026.05 | 70.76 | — | — | |
| LSTM2026.03 | 70.48 | 91.06 | 57.49 | |
| LSTMPublication=19972026.05 | 70.48 | — | — | |
| TCN2026.03 | 70.45 | 86.9 | 59.23 | |
| TCNPublication=20182026.05 | 70.45 | — | — | |
| Reformer2026.03 | 70.4 | 90.91 | 57.44 | |
| Reformer_suffix=true2025.08 | 70.4 | — | — | |
| Reformer2026.03 | 70.4 | 90.91 | 57.44 | |
| ReformerPublication=ICLR 20202026.05 | 70.4 | — | — | |
| LogTrans2026.03 | 69.97 | 89.15 | 57.59 | |
| LogTransPublication=NeurIPS 20192026.05 | 69.97 | — | — | |
| Informer2026.03 | 69.92 | 90.11 | 57.13 | |
| Informer_suffix=true2025.08 | 69.92 | — | — | |
| Informer2026.03 | 69.92 | 90.11 | 57.13 | |
| InformerPublication=AAAI 20212026.05 | 69.92 | — | — | |
| Transformer2026.03 | 69.7 | 89.37 | 57.12 | |
| TransformerPublication=NeurIPS 20172026.05 | 69.7 | — | — | |
| BeatGANProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 69.61 | 92.38 | 55.85 | |
| ETSformer2026.03 | 69.5 | 92.25 | 55.75 | |
| ETSformer2026.03 | 69.5 | 92.25 | 55.75 | |
| ETSformerPublication=ICML 20222026.05 | 69.5 | — | — | |
| Moment2025.08 | 69.43 | — | — | |
| TimeNet2026.03 | 69.39 | 90.14 | 56.4 | |
| DLinear2026.03 | 69.26 | 92.32 | 55.41 | |
| DLinear2025.08 | 69.26 | — | — | |
| DLinearPublication=AAAI 20232026.05 | 69.26 | — | — | |
| LightTS2026.03 | 69.21 | 92.58 | 55.27 | |
| LightTS2025.08 | 69.21 | — | — | |
| LightTS2026.03 | 69.21 | 92.58 | 55.27 | |
| LightTSPublication=AAAI 20222026.05 | 69.21 | — | — | |
| CrossFormer2026.03 | 69.14 | 92.04 | 55.37 | |
| Deep-SVDDProtocol=Segment-detection, Evaluation=Averaged over five seeds2025.09 | 69.04 | 89.93 | 56.02 | |
| Deep-SVDDEvaluation Protocol=Point-adjustment2025.01 | 69.04 | 89.93 | 56.02 |