Fault attribution on Who&When Hand (58 traces) benchmark leaderboard · SOTA2 Research

Fault attribution on Who&When Hand (58 traces)

31Top AccuracyRAFFLES

Evaluation Results

Method	Links
RAFFLES2026.06		31	39.7	39.7	41.4	48.3	50
RAFFLES2026.06		31	39.7	39.7	41.4	50	51.7
RAFFLES2026.06		29.3	39.7	39.7	41.4	48.3	48.3
SAFARI2026.06		27.6	41.4	41.4	48.3	55.2	55.2
RAFFLES2026.06		25.9	34.5	34.5	37.9	46.6	46.6
SAFARI2026.06		25.9	41.4	41.4	46.6	56.9	56.9
SAFARI2026.06		25.9	36.2	37.9	43.1	53.4	53.4
SAFARI2026.06		22.4	37.9	37.9	43.1	55.2	55.2
single shot2026.06		20.7	29.3	29.3	39.7	53.4	56.9
single shot2026.06		15.5	24.1	24.1	36.2	48.3	50
single shot2026.06		15.5	24.1	24.1	34.5	50	51.7
single shot2026.06		15.5	20.7	20.7	32.8	46.6	50
Step-by-step2026.06		13.8	20.7	25.9	31	46.6	50
Step-by-step2026.06		13.8	20.7	25.9	31	46.6	50
Step-by-step2026.06		12.1	19	24.1	31	46.6	50
Step-by-step2026.06		12.1	20.7	25.9	32.8	48.3	51.7