Code Generation on APPS (Avg@8)
33.7Avg@8AERO
Evaluation results
| Method | Links | |
|---|---|---|
| AEROBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=6.95, FLOPs (PetaFLOP)=2295, p-value=—2026.02 | 33.7 | |
| DAPOBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=7.75, FLOPs (PetaFLOP)=2941, p-value== 0.0342026.02 | 31 | |
| GRPOBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=11.66, FLOPs (PetaFLOP)=4488, p-value=< 0.0052026.02 | 29.8 | |
| Base ModelBackbone=Qwen2.5-7B-Instruct-1M, Time (min)=—, FLOPs (PetaFLOP)=—, p-value=< 1e-52026.02 | 18.8 |