Answer Verification on MATH
0.9128AUROCMSV 64
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MSV 64Sequences=64, Evaluation Protocol=Streaming2026.03 | 0.9128 | 0.1147 | |
| MSV 16N sequences=16, Weighted Voting=False2026.03 | 0.9062 | 0.1255 | |
| MSV 64N sequences=64, Weighted Voting=False2026.03 | 0.9049 | 0.1261 | |
| MSV 16Sequences=16, Evaluation Protocol=Streaming2026.03 | 0.9037 | 0.1104 | |
| MSV 4N sequences=4, Weighted Voting=False2026.03 | 0.8945 | 0.1348 | |
| MSV 4Sequences=4, Evaluation Protocol=Streaming2026.03 | 0.8917 | 0.1324 | |
| ProbeN sequences=1, Weighted Voting=False2026.03 | 0.879 | 0.1346 | |
| Probe + WV 4Sequences=4, Evaluation Protocol=Weighted Voting2026.03 | 0.8769 | 0.1563 | |
| Probe + WV 16Sequences=16, Evaluation Protocol=Weighted Voting2026.03 | 0.8769 | 0.1563 | |
| Probe + WV 64Sequences=64, Evaluation Protocol=Weighted Voting2026.03 | 0.8769 | 0.1563 | |
| ProbeEvaluation Protocol=Streaming2026.03 | 0.869 | 0.1592 | |
| MSV 1 + WV 4Sequences=4, Evaluation Protocol=MSV 1 + Weighted Voting2026.03 | 0.8567 | 0.1629 | |
| MSV 1 + WV 16Sequences=16, Evaluation Protocol=MSV 1 + Weighted Voting2026.03 | 0.8567 | 0.1629 | |
| MSV 1 + WV 64Sequences=64, Evaluation Protocol=MSV 1 + Weighted Voting2026.03 | 0.8567 | 0.1629 | |
| MSV 1N sequences=1, Weighted Voting=False2026.03 | 0.8566 | 0.146 | |
| MSV 1Sequences=1, Evaluation Protocol=Streaming2026.03 | 0.8443 | 0.1601 | |
| MSV 1 + WV 64N sequences=64, Weighted Voting=True2026.03 | 0.8364 | 0.138 | |
| Probe + WV 64N sequences=64, Weighted Voting=True2026.03 | 0.8346 | 0.137 | |
| Probe(EOS)Model=Gemma3-12B2025.08 | 0.834 | — | |
| Probe(AVG)Model=Fanar1-9b2025.08 | 0.833 | — | |
| Prob(Exact)Model=Fanar1-9b2025.08 | 0.827 | — | |
| Probe + WV 16N sequences=16, Weighted Voting=True2026.03 | 0.8228 | 0.1416 | |
| MSV 1 + WV 16N sequences=16, Weighted Voting=True2026.03 | 0.8228 | 0.1425 | |
| Probe(EU)Model=Fanar1-9b2025.08 | 0.794 | — | |
| Probe + WV 4N sequences=4, Weighted Voting=True2026.03 | 0.793 | 0.1649 | |
| MSV 1 + WV 4N sequences=4, Weighted Voting=True2026.03 | 0.792 | 0.1656 | |
| LogTokUModel=Gemma3-12B2025.08 | 0.791 | — | |
| Probe(EOS)Model=Fanar1-9b2025.08 | 0.79 | — | |
| Probe(AVG)Model=Gemma3-12B2025.08 | 0.786 | — | |
| P(true)Model=Gemma3-12B2025.08 | 0.779 | — | |
| Prob(Exact)Model=Gemma3-12B2025.08 | 0.773 | — | |
| LogProbModel=Fanar1-9b2025.08 | 0.757 | — | |
| Probe(EOS)Model=Qwen2.5-7B2025.08 | 0.703 | — | |
| Probe(AVG)Model=Qwen2.5-7B2025.08 | 0.699 | — | |
| LogProbModel=Gemma3-12B2025.08 | 0.683 | — | |
| Probe(EU)Model=Gemma3-12B2025.08 | 0.669 | — | |
| LogTokUModel=Fanar1-9b2025.08 | 0.666 | — | |
| P(true)Model=Qwen2.5-7B2025.08 | 0.664 | — | |
| Probe(EU)Model=Qwen2.5-7B2025.08 | 0.646 | — | |
| P(true)Model=Fanar1-9b2025.08 | 0.635 | — | |
| LogProbModel=Qwen2.5-7B2025.08 | 0.635 | — | |
| Prob(Exact)Model=Qwen2.5-7B2025.08 | 0.627 | — | |
| LogTokUModel=Qwen2.5-7B2025.08 | 0.565 | — |