Logical Reasoning on KK 2–3 ppl.
86.8AccuracyOracle Verifier
Evaluation Results
| Method | Links | |
|---|---|---|
| Oracle VerifierModel Size=12B2026.05 | 86.8 | |
| SimpleSEModel Size=12B, Verifier threshold (τ)=0.62026.05 | 84.8 | |
| RevisionSEModel Size=12B2026.05 | 84.8 | |
| SimpleSEModel Size=12B, Verifier threshold (τ)=0.72026.05 | 83 | |
| SimpleSEModel Size=12B, Verifier threshold (τ)=0.82026.05 | 80.5 | |
| Oracle VerifierModel Size=4B2026.05 | 78.4 | |
| SimpleSEModel Size=12B, Verifier threshold (τ)=0.52026.05 | 78.3 | |
| gemma-3-12b-itModel Size=12B2026.05 | 77.7 | |
| RevisionSEModel Size=4B2026.05 | 75.8 | |
| SimpleSEModel Size=4B, Verifier threshold (τ)=0.62026.05 | 70.9 | |
| SimpleSEModel Size=4B, Verifier threshold (τ)=0.52026.05 | 70.8 | |
| SimpleSEModel Size=4B, Verifier threshold (τ)=0.82026.05 | 70.4 | |
| SimpleSEModel Size=4B, Verifier threshold (τ)=0.72026.05 | 70.1 | |
| gemma-3-4b-itModel Size=4B2026.05 | 62 | |
| Oracle VerifierModel Size=1B2026.05 | 32.6 | |
| SimpleSEModel Size=1B, Verifier threshold (τ)=0.82026.05 | 23.8 | |
| RevisionSEModel Size=1B2026.05 | 22.4 | |
| gemma-3-1b-itModel Size=1B2026.05 | 20.9 | |
| SimpleSEModel Size=1B, Verifier threshold (τ)=0.72026.05 | 19 | |
| SimpleSEModel Size=1B, Verifier threshold (τ)=0.62026.05 | 17 | |
| SimpleSEModel Size=1B, Verifier threshold (τ)=0.52026.05 | 15.2 |