Question Answering on HotpotQA (ASR variants and CR) benchmark leaderboard · SOTA2 Research

Question Answering on HotpotQA (ASR variants and CR)

45EMNon-attack

Evaluation Results

Method	Links
Non-attack2026.04		45	—	—	—	93.2
Non-attack2026.04		44.4	—	—	—	92.2
JailAgent2026.04		44.4	43.8	40.8	39.2	91.8
Non-attack2026.04		42.2	—	—	—	91.4
JailAgent2026.04		42.2	42.4	37.2	37.6	91
JailAgent2026.04		41.8	36.4	35.4	33.2	89.4
Non-attack2026.04		41.8	—	—	—	89.8
Non-attack2026.04		41.4	—	—	—	89.2
JailAgent2026.04		41.2	36.2	33.2	33	90.6
AgentPoison2026.04		38.4	34.2	31.2	30.4	90.8
JailAgent2026.04		37.8	38.8	35.6	36.6	90.2
AgentPoison2026.04		36.8	38.2	34.4	34	85.8
AgentPoison2026.04		35.4	33.4	30.2	30	83.8
BadChain2026.04		34.8	37.4	33.6	32.2	81.2
BadChain2026.04		34.8	35.6	33.2	33	85.6
AgentPoison2026.04		34.4	36.6	33.2	31.2	85.6
BadChain2026.04		33.4	30.2	26	25.8	83.4
AgentPoison2026.04		33.4	35.2	31.4	31.8	86.2
Non-attack2026.04		32	—	—	—	84.4
BadChain2026.04		31.8	33.8	30.4	29.2	82.2
JailAgent2026.04		31.4	34.8	35.6	33.2	83.6
PAIR2026.04		30.4	30.2	27	26.2	78.8
BadChain2026.04		29.8	30.8	27.6	27.2	81.6
BadChain2026.04		29.6	30.6	27.8	26.6	81.4
AgentPoison2026.04		29.4	30.2	27.4	27.2	80.6
PAIR2026.04		28.4	22.4	19.8	19.2	73.2
PAIR2026.04		28.4	29.2	24	24.2	79.2
Non-attack2026.04		27.8	—	—	—	57.8
JailAgent2026.04		27.2	33.2	31.2	30.6	55.6
PAIR2026.04		26.6	27.6	23.2	23.5	75.6
PAIR2026.04		26.4	23.2	22.4	22.2	77.4
PAIR2026.04		25.8	21.8	19.2	18.6	80.8
AgentPoison2026.04		23.8	29.6	26.4	26.2	50.8
BadChain2026.04		21.8	27.8	26.2	25.6	45.6
PAIR2026.04		20.8	19.6	12.8	12.8	44.8