List your company
ResearchFormerly WizWand

Step-level reasoning verification on Calendar

69.8PR-AUCReProbe, Hidden States, GPT-OSS-anno
29.34439.84750.3560.853Nov 9, 2025
Updated 6mo ago

Evaluation results

MethodLinks
ReProbe, Hidden States, GPT-OSS-anno# Sample=10.8K, Verifying Model=Qwen3-32B, Thinking Mode=native2025.1169.8
Qwen2.5-Math-PRM-7B# Sample=860K, Verifying Model=Qwen3-32B, Thinking Mode=native2025.1167.6
Universal-PRM-Qwen2.5-Math-7B# Sample=690K, Verifying Model=Qwen3-32B, Thinking Mode=native2025.1163.7
Qwen2.5-Math-7B-PRM800K# Sample=263K, Verifying Model=Qwen3-32B, Thinking Mode=native2025.1159.4
ReProbe, Attn+Logit, Qwen3-8B-anno# Sample=32K2025.1159.2
Qwen2.5-Math-7B-PRM800k# Sample=265K2025.1156.8
Qwen2.5-Math-7B# Sample=860K2025.1155.5
Skywork-PRM-1.5B# Sample=Unk, Verifying Model=Qwen3-32B, Thinking Mode=native2025.1150.8
Universal-PRM-Qwen2.5-Math-7B# Sample=690K2025.1149.7
Math-Shepherd-PRM-7B# Sample=440K2025.1148.9
H4-Qwen2.5-PRM-1.5B-0.2# Sample=369K2025.1143.4
H4-Qwen2.5-PRM-1.5B-0.2# Sample=369K, Verifying Model=Qwen3-32B, Thinking Mode=native2025.1138.6
MaxProb# Sample=-2025.1138
MaxEntropy# Sample=-2025.1136.2
RLHFlow-PRM-Deepseek-8B# Sample=253K2025.1134.3
Skywork-PRM-1.5B# Sample=Unk2025.1132.7
Random# Sample=-2025.1132.4
Perplexity# Sample=-2025.1132.3
RLHFlow-PRM-Mistral-8B# Sample=273K2025.1130.9