List your company
ResearchFormerly WizWand

Software Engineering Agent Task on SWE-Bench Pro (pass@3)

100Pass@3LLM Agent (forced-injection)
43.8458.427387.58May 8, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LLM Agent (forced-injection)Dimension=Input, Injection Condition=Inj-10, n=242026.05100
LLM Agent (forced-injection)Dimension=Input, Injection Condition=Inj-30, n=242026.0592
LLM Agent (forced-injection)Dimension=Context, Injection Condition=Inj-10, n=122026.0592
LLM Agent (forced-injection)Dimension=Context, Injection Condition=Inj-30, n=122026.0592
LLM Agent (forced-injection)Dimension=Context, Injection Condition=Inj-70, n=122026.0592
LLM Agent (forced-injection)Dimension=Context, Injection Condition=Inj-90, n=122026.0592
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=Inj-10, n=212026.0586
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=Oracle, n=212026.0583
LLM Agent (forced-injection)Dimension=Input, Injection Condition=Oracle, n=242026.0583
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=Inj-30, n=212026.0581
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=Inj-70, n=212026.0581
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=Oracle, n=312026.0581
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=Inj-10, n=312026.0581
LLM Agent (forced-injection)Dimension=Input, Injection Condition=Inj-50, n=242026.0579
LLM Agent (forced-injection)Dimension=Input, Injection Condition=Inj-70, n=242026.0579
LLM Agent (forced-injection)Dimension=Input, Injection Condition=Inj-90, n=242026.0575
LLM Agent (forced-injection)Dimension=Context, Injection Condition=NC, n=122026.0575
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=Inj-30, n=312026.0574
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=Inj-50, n=312026.0574
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=Inj-70, n=312026.0574
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=Inj-90, n=212026.0571
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=Inj-90, n=312026.0568
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=Inj-50, n=212026.0567
LLM Agent (forced-injection)Dimension=Context, Injection Condition=Oracle, n=122026.0567
LLM Agent (forced-injection)Dimension=Context, Injection Condition=Inj-50, n=122026.0567
LLM Agent (forced-injection)Dimension=Input, Injection Condition=NC, n=242026.0563
LLM Agent (forced-injection)Dimension=Constraint, Injection Condition=NC, n=312026.0556
LLM Agent (forced-injection)Dimension=Goal, Injection Condition=NC, n=212026.0546