Window-level anti-pattern detection on TorchTraceAP (Unseen)
67.12AUC-ROCOurs
Evaluation results
| Method | Links | |
|---|---|---|
| OursNumber of Windows (Nw)=502025.12 | 67.12 | |
| OursNumber of Windows (Nw)=1002025.12 | 65.22 | |
| OursNumber of Windows (Nw)=1002025.12 | 63.57 | |
| OursNumber of Windows (Nw)=502025.12 | 63.18 | |
| OursNumber of Windows (Nw)=2002025.12 | 63.07 | |
| OursNumber of Windows (Nw)=2002025.12 | 60.64 | |
| Pure LLMNumber of Windows (Nw)=502025.12 | 56.82 | |
| Pure LLMNumber of Windows (Nw)=1002025.12 | 55.31 | |
| RuleNumber of Windows (Nw)=502025.12 | 54.31 | |
| RuleNumber of Windows (Nw)=1002025.12 | 54.19 | |
| Pure LLMNumber of Windows (Nw)=2002025.12 | 53.79 | |
| Pure LLMNumber of Windows (Nw)=502025.12 | 53.76 | |
| Pure LLMNumber of Windows (Nw)=1002025.12 | 53.32 | |
| Pure LLMNumber of Windows (Nw)=2002025.12 | 53.31 | |
| RuleNumber of Windows (Nw)=1002025.12 | 53.11 | |
| RuleNumber of Windows (Nw)=502025.12 | 52.47 | |
| RuleNumber of Windows (Nw)=2002025.12 | 52.38 | |
| RuleNumber of Windows (Nw)=2002025.12 | 52.16 | |
| ClusteringNumber of Windows (Nw)=502025.12 | 51.01 | |
| ClusteringNumber of Windows (Nw)=502025.12 | 50.93 | |
| ClusteringNumber of Windows (Nw)=2002025.12 | 50.74 | |
| ClusteringNumber of Windows (Nw)=2002025.12 | 50.63 | |
| ClusteringNumber of Windows (Nw)=1002025.12 | 50.51 | |
| ClusteringNumber of Windows (Nw)=1002025.12 | 50.21 |