Question Answering on StrategyQA (ASR & EM/CR) benchmark leaderboard · SOTA2 Research

Question Answering on StrategyQA (ASR & EM/CR)

85.59Exact Match (EM)Non-attack

Evaluation Results

Method	Links
Non-attack2026.04		85.59	—	—	—	96.94
AgentPoison2026.04		83.41	67.25	62.88	61.57	93.45
JailAgent2026.04		82.97	74.67	72.05	72.49	94.32
Non-attack2026.04		81.66	—	—	—	93.89
Non-attack2026.04		81.22	—	—	—	90.83
PAIR2026.04		81.22	58.08	53.71	52.4	86.03
Non-attack2026.04		80.79	—	—	—	89.96
JailAgent2026.04		80.79	70.31	67.69	66.81	90.83
JailAgent2026.04		80.35	73.8	65.07	62.88	90.39
JailAgent2026.04		79.91	72.05	67.25	65.94	89.52
AgentPoison2026.04		79.6	66.81	62.45	61.13	91.7
AgentPoison2026.04		78.6	69.87	58.95	55.9	86.9
BadChain2026.04		78.17	60.7	59.83	55.46	88.65
BadChain2026.04		76.42	62.88	54.59	52.4	83.84
AgentPoison2026.04		75.55	63.32	55.02	53.71	88.21
BadChain2026.04		74.67	62.88	61.14	58.52	87.34
PAIR2026.04		74.24	58.95	49.78	45.85	82.97
BadChain2026.04		72.93	56.33	52.4	48.91	83.84
PAIR2026.04		71.61	55.9	49.34	48.47	79.91
JailAgent2026.04		69.87	69.43	61.14	60.7	83.84
PAIR2026.04		69.87	52.4	48.03	48.47	86.9
Non-attack2026.04		69.43	—	—	—	85.15
Non-attack2026.04		68.56	—	—	—	85.59
JailAgent2026.04		67.69	54.59	51.52	48.91	83.41
AgentPoison2026.04		65.94	65.5	56.77	55.9	77.73
AgentPoison2026.04		65.5	54.15	51.09	47.16	79.04
BadChain2026.04		63.32	49.78	46.72	44.54	78.6
PAIR2026.04		62.45	43.67	44.1	42.36	74.24
PAIR2026.04		59.39	54.59	48.47	42.79	74.24
Non-attack2026.04		58.95	—	—	—	66.81
JailAgent2026.04		58.95	57.64	58.95	56.33	65.94
BadChain2026.04		50.66	49.34	44.1	43.67	70.74
BadChain2026.04		48.03	46.72	45.41	43.23	56.77
AgentPoison2026.04		47.6	48.47	45.41	44.98	59.39
PAIR2026.04		44.98	43.67	41.92	42.36	59.83