List your company
ResearchFormerly WizWand

Fault Attribution on TRAIL SWEBench 31 traces

45.16PrecisionRAFFLES
8.260817.840427.4236.9996Jun 23, 2026
Updated 4mo ago

Evaluation results

MethodLinks
RAFFLESModel=claude-opus-4.6, Context Budget=1M token2026.0645.1625.81
RAFFLESModel=claude-opus-4.6, Context Budget=200K token2026.0645.1629.03
RAFFLESModel=claude-opus-4.6, Context Budget=100K token2026.0645.1632.26
SAFARIModel=claude-opus-4.6, Context Budget=25K token2026.0641.9429.03
single shotModel=claude-opus-4.6, Context Budget=100K token2026.0635.4825.81
SAFARIModel=claude-opus-4.6, Context Budget=100K token2026.0635.4819.35
RAFFLESModel=claude-opus-4.6, Context Budget=25K token2026.0635.4819.35
single shotModel=claude-opus-4.6, Context Budget=1M token2026.0629.0312.9
Step-by-stepModel=claude-opus-4.6, Context Budget=1M token2026.0629.0319.35
single shotModel=claude-opus-4.6, Context Budget=200K token2026.0629.0312.9
Step-by-stepModel=claude-opus-4.6, Context Budget=200K token2026.0629.0319.35
Step-by-stepModel=claude-opus-4.6, Context Budget=100K token2026.0629.0319.35
Step-by-stepModel=claude-opus-4.6, Context Budget=25K token2026.0629.0319.35
SAFARIModel=claude-opus-4.6, Context Budget=1M token2026.0622.589.68
SAFARIModel=claude-opus-4.6, Context Budget=200K token2026.0622.5812.9
single shotModel=claude-opus-4.6, Context Budget=25K token2026.069.680