List your company

Code Generation on HumanEval-Pro Held-out after Compositional Stream

72.5AccuracyReAct
60.33263.49166.6569.809Jun 1, 2026

Evaluation results

MethodLinks
ReActcontext=Held-out2026.0672.5—
MEMPROBEcontext=Held-out2026.0671.70.8
LangMemcontext=Held-out2026.0670.81.7
Mem0context=Held-out2026.0670.81.7
AWMcontext=Held-out2026.06702.5
ExpRAGcontext=Held-out2026.0668.34.2
ReMemcontext=Held-out2026.0667.55
DC-RScontext=Held-out2026.0660.811.7