List your company

Code Generation on HumanEval (Pass Rate, CodeBLEU, Iteration Metrics)

97.86Pass RateIterative
24.113643.259362.40581.5507Jun 18, 2026

Evaluation results

MethodLinks
IterativeModels=Gemini2026.0697.861.90.950.750.830.48
Refactoring-BasedModels=Claude2026.0697.86—0.6930.0130.150.79
IterativeModels=Claude2026.0697.321.310.9030.5630.680.5
No WatermarkModels=Claude2026.0696.28—0.3620.0180.030.49
StaticModels=Claude2026.0695.64—0.7730.240.410.49
Refactoring-BasedModels=Gemini2026.0695.63—0.890.210.510.5
ICWModels=Claude2026.0694.95—0.740.010.120.49
Iterative-AGLModels=Claude2026.06941.830.930.640.710.48
Comment-basedModels=Claude2026.0691.86—0.8550.420.590.49
StaticModels=Gemini2026.0690—0.810.160.350.49
Comment-basedModels=Gemini2026.0688.9—0.850.330.510.47
Iterative-AGLModels=Gemini2026.0688.91.930.970.90.90.48
ICWModels=Gemini2026.0686.7—0.40.010.040.48
No WatermarkModels=Gemini2026.0685.5—0.530.040.090.48
SWEETModels=Qwen2026.0626.95—0.810.450.540.31