Cybersecurity Incident Response on 120-event corpus seed 42 benchmark leaderboard · SOTA2 Research

Cybersecurity Incident Response on 120-event corpus seed 42

58TP (True Positives)Agentra (M4)

Evaluation Results

Method	Links
Agentra (M4)2026.06		58	0	27	35	68	100	81	90	73	68	0
Agentra (M4)2026.06		56	2	28	34	67	97	79	93	72	68	0.9
Agentra (M5)2026.06		53	5	24	38	69	91	79	80	31	23	14.2
Agentra (M1)2026.06		52	6	14	48	79	90	84	47	84	84	0
Agentra (M4)2026.06		52	6	29	33	64	90	75	97	37	15	16
Agentra (M4)2026.06		52	6	25	37	68	90	77	83	37	15	17.5
Agentra (M1)2026.06		48	10	13	49	79	83	81	43	79	79	0
Agentra (M2)2026.06		38	20	10	52	79	66	72	33	76	76	0
Agentra (M3)2026.06		38	20	13	49	75	66	70	43	72	73	0
Agentra (M2)2026.06		36	22	8	54	82	62	71	27	75	75	0
Agentra (M5)2026.06		36	22	9	53	80	62	70	30	96	95	0
Agentra (M5)2026.06		33	25	8	54	81	57	67	27	95	95	0
CACAO baseline2026.06		32	26	15	47	68	55	61	50	37	85	0
CACAO baseline2026.06		32	26	15	47	68	55	61	50	37	85	0
Agentra (M2)2026.06		32	26	17	45	65	55	60	57	24	30	10.4
CACAO baseline2026.06		32	26	15	47	68	55	61	50	37	85	0
Agentra (M3)2026.06		32	26	12	50	73	55	63	40	77	77	0
CACAO baseline2026.06		32	26	15	47	68	55	61	50	37	85	0
CACAO baseline2026.06		32	26	15	47	68	55	61	50	37	85	0
Agentra (M1)2026.06		29	29	8	54	78	50	61	27	16	22	4.3
Agentra (M1)2026.06		27	31	6	56	82	47	59	20	17	23	6.3
Agentra (M3)2026.06		23	35	10	52	70	40	51	33	24	30	5.4
Agentra (M3)2026.06		20	38	13	49	61	34	44	43	23	27	8.5
Agentra (M2)2026.06		17	41	8	54	68	29	41	27	19	26	2.2
Agentra (M5)2026.06		8	50	1	61	89	14	24	3	42	20	33.3