Mathematical Reasoning on MATH (Latency)
17.6Latency (MATH)Probe
Evaluation Results
| Method | Links | |
|---|---|---|
| ProbeN=64, Verifier=Probe, Early stopping=true, Fixed target accuracy=matching or surpassing pass@12026.03 | 17.6 | |
| ProbeN=128, Verifier=Probe, Early stopping=true, Fixed target accuracy=matching or surpassing pass@12026.03 | 19.6 | |
| ProbeN=16, Verifier=Probe, Early stopping=true, Fixed target accuracy=matching or surpassing pass@12026.03 | 22.9 | |
| ProbeN=4, Verifier=Probe, Early stopping=true, Fixed target accuracy=matching or surpassing pass@12026.03 | 25.8 | |
| ProbeN=1, Verifier=Probe, Early stopping=true, Fixed target accuracy=matching or surpassing pass@12026.03 | 51.8 |