Code on HumanEval
1True WS ScorePromptCOS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PromptCOSModel=CodeGemma-2b2025.09 | 1 | 0.04 | 0.94 | |
| PromptCOSModel=CodeGemma-7b2025.09 | 1 | 0.14 | 0.84 | |
| PRModel=CodeGemma-7b2025.09 | 0.99 | 0.85 | 0 | |
| PRModel=CodeGemma-2b2025.09 | 0.91 | 0.91 | -0.03 | |
| PC*Model=CodeGemma-7b2025.09 | 0.37 | 0.02 | 0.34 | |
| PC*Model=CodeGemma-2b2025.09 | 0.36 | 0.04 | 0.3 | |
| PCGModel=CodeGemma-7b2025.09 | 0.31 | 0.14 | 0.13 | |
| PCGModel=CodeGemma-2b2025.09 | 0 | 0 | 0 |