Cybersecurity Incident Response on 120-event corpus seed 42
58TP (True Positives)Agentra (M4)
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Agentra (M4)Ablation Stage=A42026.06 | 58 | 0 | 27 | 35 | 68 | 100 | 81 | 90 | 73 | 68 | 0 | |
| Agentra (M4)Ablation Stage=A32026.06 | 56 | 2 | 28 | 34 | 67 | 97 | 79 | 93 | 72 | 68 | 0.9 | |
| Agentra (M5)Ablation Stage=A12026.06 | 53 | 5 | 24 | 38 | 69 | 91 | 79 | 80 | 31 | 23 | 14.2 | |
| Agentra (M1)Ablation Stage=A42026.06 | 52 | 6 | 14 | 48 | 79 | 90 | 84 | 47 | 84 | 84 | 0 | |
| Agentra (M4)Ablation Stage=A12026.06 | 52 | 6 | 29 | 33 | 64 | 90 | 75 | 97 | 37 | 15 | 16 | |
| Agentra (M4)Ablation Stage=A22026.06 | 52 | 6 | 25 | 37 | 68 | 90 | 77 | 83 | 37 | 15 | 17.5 | |
| Agentra (M1)Ablation Stage=A32026.06 | 48 | 10 | 13 | 49 | 79 | 83 | 81 | 43 | 79 | 79 | 0 | |
| Agentra (M2)Ablation Stage=A42026.06 | 38 | 20 | 10 | 52 | 79 | 66 | 72 | 33 | 76 | 76 | 0 | |
| Agentra (M3)Ablation Stage=A32026.06 | 38 | 20 | 13 | 49 | 75 | 66 | 70 | 43 | 72 | 73 | 0 | |
| Agentra (M2)Ablation Stage=A32026.06 | 36 | 22 | 8 | 54 | 82 | 62 | 71 | 27 | 75 | 75 | 0 | |
| Agentra (M5)Ablation Stage=A32026.06 | 36 | 22 | 9 | 53 | 80 | 62 | 70 | 30 | 96 | 95 | 0 | |
| Agentra (M5)Ablation Stage=A42026.06 | 33 | 25 | 8 | 54 | 81 | 57 | 67 | 27 | 95 | 95 | 0 | |
| CACAO baselineCombo=M1, Ablation Stage=A02026.06 | 32 | 26 | 15 | 47 | 68 | 55 | 61 | 50 | 37 | 85 | 0 | |
| CACAO baselineCombo=M2, Ablation Stage=A02026.06 | 32 | 26 | 15 | 47 | 68 | 55 | 61 | 50 | 37 | 85 | 0 | |
| Agentra (M2)Ablation Stage=A12026.06 | 32 | 26 | 17 | 45 | 65 | 55 | 60 | 57 | 24 | 30 | 10.4 | |
| CACAO baselineCombo=M3, Ablation Stage=A02026.06 | 32 | 26 | 15 | 47 | 68 | 55 | 61 | 50 | 37 | 85 | 0 | |
| Agentra (M3)Ablation Stage=A42026.06 | 32 | 26 | 12 | 50 | 73 | 55 | 63 | 40 | 77 | 77 | 0 | |
| CACAO baselineCombo=M4, Ablation Stage=A02026.06 | 32 | 26 | 15 | 47 | 68 | 55 | 61 | 50 | 37 | 85 | 0 | |
| CACAO baselineCombo=M5, Ablation Stage=A02026.06 | 32 | 26 | 15 | 47 | 68 | 55 | 61 | 50 | 37 | 85 | 0 | |
| Agentra (M1)Ablation Stage=A12026.06 | 29 | 29 | 8 | 54 | 78 | 50 | 61 | 27 | 16 | 22 | 4.3 | |
| Agentra (M1)Ablation Stage=A22026.06 | 27 | 31 | 6 | 56 | 82 | 47 | 59 | 20 | 17 | 23 | 6.3 | |
| Agentra (M3)Ablation Stage=A12026.06 | 23 | 35 | 10 | 52 | 70 | 40 | 51 | 33 | 24 | 30 | 5.4 | |
| Agentra (M3)Ablation Stage=A22026.06 | 20 | 38 | 13 | 49 | 61 | 34 | 44 | 43 | 23 | 27 | 8.5 | |
| Agentra (M2)Ablation Stage=A22026.06 | 17 | 41 | 8 | 54 | 68 | 29 | 41 | 27 | 19 | 26 | 2.2 | |
| Agentra (M5)Ablation Stage=A22026.06 | 8 | 50 | 1 | 61 | 89 | 14 | 24 | 3 | 42 | 20 | 33.3 |