List your company

Code Generation on HumanEval+ (avg@4)

79.6Pass Rate @4SHEAR
59.21664.50869.875.092Apr 25, 2026

Evaluation results

MethodLinks
SHEARBackbone=Qwen2.5-14B-Base2026.0479.6
GRPOBackbone=Qwen2.5-14B-Base2026.0479.3
SHEARBackbone=Qwen2.5-Coder-7B2026.0472.1
GRPOBackbone=Qwen2.5-Coder-7B2026.0471
SHEARBackbone=Llama3.1-8B-Instruct2026.0463.5
GRPOBackbone=Llama3.1-8B-Instruct2026.0460