List your company
ResearchFormerly WizWand

Coding on Coding (val)

100Pass@16GRPO
74.62481.21287.894.388Nov 6, 2025
Updated 7mo ago

Evaluation results

MethodLinks
GRPODifficulty=Easy, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1110095.8
CoRPODifficulty=Easy, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1110094.6
GRPODifficulty=Medium, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1110093.1
CoRPODifficulty=Medium, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1110088.8
GRPODifficulty=Easy, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1110090.1
CoRPODifficulty=Easy, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1110088.9
CoRPODifficulty=Medium, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1110067.2
GRPODifficulty=Medium, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1196.662.5
GRPODifficulty=Overall, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1187.867.1
CoRPODifficulty=Overall, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1187.265.5
CoRPODifficulty=Overall, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1183.947.2
GRPODifficulty=Overall, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1183.447
GRPODifficulty=Hard, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1181.753.4
CoRPODifficulty=Hard, Validation Set Domain=In-domain, Train Set=Coding, MSL=16k, Temperature=0.32025.1180.952.4
GRPODifficulty=Hard, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1175.631.3
CoRPODifficulty=Hard, Validation Set Domain=Out-of-domain, Train Set=Math, MSL=16k, Temperature=0.32025.1175.630.9