List your company

Code Generation on BigCodeBench instruction split (test)

37.86Pass RateTEXTRESNET
27.376830.098432.8235.5416Feb 9, 2026

Evaluation results

MethodLinks
TEXTRESNETmode=deep residual tuning2026.0237.86
TextGradsummarization=false2026.0235.71
TextGradsummarization=true2026.0235.12
CoTmode=unoptimized lower bound2026.0234.15
DSPyoptimizer=MIPRO2026.0233.81
HBCmode=hierarchical imitation learning2026.0227.78