Mathematical Reasoning on Math-Synth
0.849Sel-AUCStructU+Self-ConsU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StructU+Self-ConsUModel=GPT-OSS 20B, Aggregation=across2026.06 | 0.849 | 0.956 | |
| StructU+Self-ConsUModel=GPT-OSS 20B, Aggregation=total2026.06 | 0.849 | 0.958 | |
| StructU+Self-ConsUModel=GPT-OSS 20B, Aggregation=within2026.06 | 0.84 | 0.955 | |
| Self-ConsUModel=GPT-OSS 20B2026.06 | 0.83 | 0.958 | |
| StructU+Self-ConsUModel=DeepSeek R1, Aggregation=within2026.06 | 0.823 | 0.929 | |
| StructU+Self-ConsUModel=DeepSeek R1, Aggregation=across2026.06 | 0.82 | 0.924 | |
| StructUModel=DeepSeek R1, Aggregation=within2026.06 | 0.815 | 0.9 | |
| StructU+Self-ConsUModel=DeepSeek R1, Aggregation=total2026.06 | 0.814 | 0.915 | |
| Self-ConsUModel=DeepSeek R12026.06 | 0.802 | 0.899 | |
| StructUModel=GPT-OSS 20B, Aggregation=within2026.06 | 0.794 | 0.756 | |
| VerbalizedUModel=DeepSeek R12026.06 | 0.793 | 0.701 | |
| VerbalizedUModel=GPT-OSS 20B2026.06 | 0.792 | 0.742 | |
| StructUModel=DeepSeek R1, Aggregation=across2026.06 | 0.79 | 0.837 | |
| StructUModel=DeepSeek R1, Aggregation=total2026.06 | 0.773 | 0.79 | |
| StructUModel=GPT-OSS 20B, Aggregation=across2026.06 | 0.762 | 0.668 | |
| SemanticUModel=DeepSeek R12026.06 | 0.664 | 0.502 | |
| StructU+Self-ConsUModel=Claude 4.5 Sonnet, Aggregation=across2026.06 | 0.663 | 0.99 | |
| StructU+Self-ConsUModel=Claude 4.5 Sonnet, Aggregation=within2026.06 | 0.661 | 0.992 | |
| StructUModel=GPT-OSS 20B, Aggregation=total2026.06 | 0.661 | 0.366 | |
| StructU+Self-ConsUModel=Claude 4.5 Sonnet, Aggregation=total2026.06 | 0.655 | 0.992 | |
| Self-ConsUModel=Claude 4.5 Sonnet2026.06 | 0.65 | 0.989 | |
| StructUModel=Claude 4.5 Sonnet, Aggregation=across2026.06 | 0.644 | 0.936 | |
| StructUModel=Claude 4.5 Sonnet, Aggregation=within2026.06 | 0.624 | 0.984 | |
| StructUModel=Claude 4.5 Sonnet, Aggregation=total2026.06 | 0.596 | 0.972 | |
| VerbalizedUModel=Claude 4.5 Sonnet2026.06 | 0.544 | 0.924 | |
| SemanticUModel=GPT-OSS 20B2026.06 | 0.528 | 0.638 | |
| StructU+Self-ConsUModel=Amazon Nova Premier, Aggregation=total2026.06 | 0.512 | 0.997 | |
| StructU+Self-ConsUModel=Amazon Nova Premier, Aggregation=within2026.06 | 0.511 | 0.997 | |
| StructU+Self-ConsUModel=Amazon Nova Premier, Aggregation=across2026.06 | 0.498 | 0.998 | |
| StructUModel=Amazon Nova Premier, Aggregation=within2026.06 | 0.496 | 0.953 | |
| StructUModel=Amazon Nova Premier, Aggregation=total2026.06 | 0.447 | 0.853 | |
| SemanticUModel=Amazon Nova Premier2026.06 | 0.436 | 0.807 | |
| SemanticUModel=Claude 4.5 Sonnet2026.06 | 0.43 | 0.927 | |
| StructU+Self-ConsUModel=Qwen 3 32B, Aggregation=within2026.06 | 0.393 | 0.998 | |
| StructU+Self-ConsUModel=Qwen 3 32B, Aggregation=across2026.06 | 0.391 | 0.998 | |
| VerbalizedUModel=Amazon Nova Premier2026.06 | 0.389 | 0.824 | |
| StructU+Self-ConsUModel=Qwen 3 32B, Aggregation=total2026.06 | 0.388 | 0.998 | |
| Self-ConsUModel=Amazon Nova Premier2026.06 | 0.382 | 0.948 | |
| Self-ConsUModel=Qwen 3 32B2026.06 | 0.38 | 0.995 | |
| StructUModel=Amazon Nova Premier, Aggregation=across2026.06 | 0.37 | 0.841 | |
| VerbalizedUModel=Qwen 3 32B2026.06 | 0.279 | 0.824 | |
| StructUModel=Qwen 3 32B, Aggregation=within2026.06 | 0.231 | 0.794 | |
| SemanticUModel=Qwen 3 32B2026.06 | 0.218 | 0.462 | |
| StructUModel=Qwen 3 32B, Aggregation=total2026.06 | 0.213 | 0.718 | |
| StructUModel=Qwen 3 32B, Aggregation=across2026.06 | 0.19 | 0.656 |