Step-level correctness assessment on ProofNet (test)
32.9PR-AUCUniversal-PRM-Qwen2.5-Math-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| Universal-PRM-Qwen2.5-Math-7B# Sample=690K2025.11 | 32.9 | |
| Qwen2.5-Math-PRM-7B# Sample=860K2025.11 | 31 | |
| Qwen2.5-Math-7B-PRM800k# Sample=265K2025.11 | 30.1 | |
| ReProbe# Sample=32K, Architecture=Hidden States, Annotation=DeepSeek-anno2025.11 | 28.1 | |
| ReProbe# Sample=32K, Architecture=Hidden States, Annotation=Self-anno2025.11 | 26.4 | |
| ReProbe# Sample=32K, Architecture=Attn+Logit, Annotation=Self-anno2025.11 | 26 | |
| ReProbe# Sample=32K, Architecture=Attn+Logit, Annotation=DeepSeek-anno2025.11 | 24.3 | |
| MaxProb# Sample=-2025.11 | 19.4 | |
| MaxEntropy# Sample=-2025.11 | 18.5 | |
| Perplexity# Sample=-2025.11 | 17.6 | |
| Semantic Entropy# Sample=-2025.11 | 17.3 | |
| P(True)# Sample=-2025.11 | 17.2 | |
| Lexical Similarity# Sample=-2025.11 | 17 | |
| CCP# Sample=-2025.11 | 16.8 | |
| H4-Qwen2.5-PRM-1.5B-0.2# Sample=369K2025.11 | 15.9 | |
| Self-Certainty# Sample=-2025.11 | 15.5 | |
| Random# Sample=-2025.11 | 15.3 | |
| Degree Matrix# Sample=-2025.11 | 14.7 | |
| Skywork-PRM-1.5B# Sample=Unk2025.11 | 14.7 | |
| Math-Shepherd-PRM-7B# Sample=440K2025.11 | 14.7 | |
| RLHFlow-PRM-Deepseek-8B# Sample=253K2025.11 | 13.6 | |
| RLHFlow-PRM-Mistral-8B# Sample=273K2025.11 | 11.8 |