List your company
ResearchFormerly WizWand

Long-context code reasoning on InfiniteBench Code-Debug (test)

86AccuracyFull context
50.931260.035669.1478.2444May 31, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Full contextTarget model=GPT-OSS-120B, Ctx. budget=120k2026.0586
Full contextTarget model=MiniMax-M2.5, Ctx. budget=152k2026.0583.76
LongAttnComp (Stage 1)Target model=GPT-OSS-120B, Ctx. budget=16k2026.0582.99
LongAttnComp (Stage 2, subq)Target model=MiniMax-M2.5, Ctx. budget=16k2026.0582.23
LongAttnComp (Stage 2, nosubq)Target model=GPT-OSS-120B, Ctx. budget=16k2026.0581.73
LongAttnComp (Stage 2, nosubq)Target model=MiniMax-M2.5, Ctx. budget=16k2026.0581.72
LongAttnComp (Stage 1)Target model=MiniMax-M2.5, Ctx. budget=16k2026.0581.22
LongAttnComp (Stage 2, subq)Target model=GPT-OSS-120B, Ctx. budget=16k2026.0580.2
LongAttnComp (Stage 2, subq)Target model=DeepSeek-R1-0528, Ctx. budget=16k2026.0576.9
LongAttnComp (Stage 2, subq)Target model=DeepSeek-R1-05282026.0576.9
LongAttnComp (Stage 1)Target model=DeepSeek-R1-0528, Ctx. budget=16k2026.0575.38
LongAttnComp (Stage 1)Target model=DeepSeek-R1-05282026.0575.38
Full contextTarget model=DeepSeek-R1-0528, Ctx. budget=120k2026.0574.37
Full contextTarget model=DeepSeek-R1-0528, Context budget=120k2026.0574.37
LongAttnComp (Stage 2, nosubq)Target model=DeepSeek-R1-0528, Ctx. budget=16k2026.0574.11
LongAttnComp (Stage 2, nosubq)Target model=DeepSeek-R1-05282026.0574.11
Full contextTarget model=DeepSeek-V3.1, Ctx. budget=128k2026.0567.51
LongAttnComp (Stage 2, nosubq)Target model=DeepSeek-V3.1, Ctx. budget=16k2026.0565.99
LongAttnComp (Stage 1)Target model=DeepSeek-V3.1, Ctx. budget=16k2026.0565.73
LongAttnComp (Stage 2, subq)Target model=DeepSeek-V3.1, Ctx. budget=16k2026.0565.48
Spec PrefillTarget model=DeepSeek-R1-0528, Ctx. budget=16k2026.0562.44
Speculative PrefillTarget model=DeepSeek-R1-05282026.0562.44
Spec PrefillTarget model=DeepSeek-V3.1, Ctx. budget=16k2026.0559.14
Spec PrefillTarget model=MiniMax-M2.5, Ctx. budget=16k2026.0557.1
Spec PrefillTarget model=GPT-OSS-120B, Ctx. budget=16k2026.0552.28