Question Answering on MuSiQue (held-out) benchmark leaderboard · SOTA2 Research

Question Answering on MuSiQue (held-out)

57.7F1 ScoreIRCOT*

Evaluation Results

Method	Links
IRCOT*2026.06		57.7	3,800
a-PRUNE2026.06		52.8	4,800
RASER-32026.06		51	2,200
a-PRUNE2026.06		50.3	3,700
RASER-22026.06		50.2	2,100
RASER-32026.06		50.2	2,400
IRCOT*2026.06		49.9	4,300
ONE-SHOT RAG2026.06		48.8	1,500
SELF-ASK*2026.06		48.2	4,600
ChainRAG†2026.06		46.5	4,600
ChainRAG†2026.06		46.4	2,300
RASER-22026.06		45.8	2,100
IRCOT*2026.06		45.5	4,300
ChainRAG†2026.06		44.5	2,300
RASER-32026.06		40.8	2,400
SELF-ASK*2026.06		40.7	3,000
a-PRUNE2026.06		39.7	3,800
ONE-SHOT RAG2026.06		39.3	1,200
SELF-ASK*2026.06		38	3,300
IRCOT*2026.06		37.6	5,100
IRCOT*2026.06		37.2	5,400
SELF-ASK*2026.06		36	3,000
RASER-32026.06		35.7	2,700
IRCOT*2026.06		35.4	4,700
a-PRUNE2026.06		35.3	3,600
RASER-22026.06		33.5	1,400
ONE-SHOT RAG2026.06		33.1	1,100
RASER-32026.06		33	3,000
ChainRAG†2026.06		31.2	2,600
RASER-32026.06		30.9	2,800
RASER-22026.06		30.6	1,900
ChainRAG†2026.06		29.3	1,900
SELF-ASK*2026.06		29.2	3,200
ONE-SHOT RAG2026.06		28.3	1,200
SELF-ASK*2026.06		27.6	3,200
a-PRUNE2026.06		26.4	3,800
a-PRUNE2026.06		25.6	3,700
RASER-22026.06		25.3	1,500
ONE-SHOT RAG2026.06		23.6	1,200
RASER-22026.06		22.9	1,600
ONE-SHOT RAG2026.06		22.3	1,200
ChainRAG†2026.06		20.9	2,800