Code Generation on Code Benchmarks Total
26.4Avg@8AERO
Evaluation results
| Method | Links | |
|---|---|---|
| AEROBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=6.95, FLOPs (PetaFLOP)=2295, p-value=—2026.02 | 26.4 | |
| DAPOBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=7.75, FLOPs (PetaFLOP)=2941, p-value== 0.0342026.02 | 25.2 | |
| GRPOBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=11.66, FLOPs (PetaFLOP)=4488, p-value=< 0.0052026.02 | 23.8 | |
| Base ModelBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=—, FLOPs (PetaFLOP)=—, p-value=< 1e-52026.02 | 14.9 |