Planning on Calendar (test)
48AccuracyReProbe
Evaluation results
| Method | Links | |
|---|---|---|
| ReProbe# Sample=32K, Input Features=Hidden States, Annotation Source=DeepSeek-anno, Decoding Method=Beam search2025.11 | 48 | |
| Qwen2.5-Math-7B-PRM800k# Sample=263K, Decoding Method=Beam search2025.11 | 45 | |
| ReProbe# Sample=32K, Input Features=Attn+Logit, Annotation Source=DeepSeek-anno, Decoding Method=Beam search2025.11 | 42.4 | |
| Qwen2.5-Math-PRM-7B# Sample=860K, Decoding Method=Beam search2025.11 | 41.5 | |
| ReProbe# Sample=32K, Input Features=Attn+Logit, Annotation Source=Self-anno, Decoding Method=Beam search2025.11 | 41.5 | |
| ReProbe# Sample=32K, Input Features=Hidden States, Annotation Source=Self-anno, Decoding Method=Beam search2025.11 | 40.5 |