Performance Prediction on HumanEval
0.685Train R^2NLL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NLLScaling Scenario=1B -> 13B, Phase Transition=Pre-to-Pre2025.09 | 0.685 | 2.111 | |
| RphiScaling Scenario=1B -> 13B, Phase Transition=Pre-to-Pre2025.09 | 0.655 | 2.041 | |
| RBRIDGEScaling Scenario=1B -> 13B, Phase Transition=Pre-to-Pre2025.09 | 0.652 | 2.025 | |
| Acc./p@1Scaling Scenario=1B -> 13B, Phase Transition=Pre-to-Pre2025.09 | 0.26 | 2.889 | |
| MPCAScaling Scenario=1B -> 13B, Phase Transition=Pre-to-Pre2025.09 | 0.179 | 3.341 | |
| TEDScaling Scenario=1B -> 13B, Phase Transition=Pre-to-Pre2025.09 | 0.057 | 2.389 |