Mathematical Reasoning on MATH 500 (Sel-AUC, AUROC)
0.95Sel-AUCStructU+Self-ConsU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| StructU+Self-ConsUModel=Claude 4.5 Sonnet, Aggregation=across2026.06 | 0.95 | 0.843 | |
| StructU+Self-ConsUModel=Claude 4.5 Sonnet, Aggregation=total2026.06 | 0.948 | 0.831 | |
| StructU+Self-ConsUModel=Claude 4.5 Sonnet, Aggregation=within2026.06 | 0.947 | 0.84 | |
| Self-ConsUModel=Claude 4.5 Sonnet2026.06 | 0.942 | 0.816 | |
| StructUModel=Claude 4.5 Sonnet, Aggregation=across2026.06 | 0.936 | 0.789 | |
| StructU+Self-ConsUModel=DeepSeek R1, Aggregation=across2026.06 | 0.936 | 0.784 | |
| StructU+Self-ConsUModel=DeepSeek R1, Aggregation=within2026.06 | 0.934 | 0.776 | |
| StructUModel=Claude 4.5 Sonnet, Aggregation=total2026.06 | 0.932 | 0.801 | |
| StructUModel=Claude 4.5 Sonnet, Aggregation=within2026.06 | 0.931 | 0.813 | |
| StructU+Self-ConsUModel=DeepSeek R1, Aggregation=total2026.06 | 0.927 | 0.767 | |
| Self-ConsUModel=DeepSeek R12026.06 | 0.923 | 0.759 | |
| StructU+Self-ConsUModel=GPT-OSS 20B, Aggregation=across2026.06 | 0.91 | 0.718 | |
| StructU+Self-ConsUModel=GPT-OSS 20B, Aggregation=total2026.06 | 0.906 | 0.729 | |
| StructU+Self-ConsUModel=GPT-OSS 20B, Aggregation=within2026.06 | 0.897 | 0.715 | |
| VerbalizedUModel=Claude 4.5 Sonnet2026.06 | 0.891 | 0.686 | |
| StructUModel=DeepSeek R1, Aggregation=across2026.06 | 0.89 | 0.64 | |
| StructUModel=DeepSeek R1, Aggregation=within2026.06 | 0.889 | 0.652 | |
| StructU+Self-ConsUModel=Qwen 3 32B, Aggregation=within2026.06 | 0.889 | 0.882 | |
| StructU+Self-ConsUModel=Qwen 3 32B, Aggregation=total2026.06 | 0.888 | 0.876 | |
| StructU+Self-ConsUModel=Amazon Nova Premier, Aggregation=within2026.06 | 0.887 | 0.873 | |
| StructUModel=GPT-OSS 20B, Aggregation=total2026.06 | 0.886 | 0.611 | |
| VerbalizedUModel=GPT-OSS 20B2026.06 | 0.886 | 0.645 | |
| StructU+Self-ConsUModel=Amazon Nova Premier, Aggregation=total2026.06 | 0.886 | 0.87 | |
| StructUModel=GPT-OSS 20B, Aggregation=across2026.06 | 0.885 | 0.529 | |
| VerbalizedUModel=Amazon Nova Premier2026.06 | 0.883 | 0.715 | |
| StructU+Self-ConsUModel=Qwen 3 32B, Aggregation=across2026.06 | 0.882 | 0.853 | |
| StructU+Self-ConsUModel=Amazon Nova Premier, Aggregation=across2026.06 | 0.88 | 0.871 | |
| VerbalizedUModel=Qwen 3 32B2026.06 | 0.88 | 0.684 | |
| SemanticUModel=DeepSeek R12026.06 | 0.875 | 0.546 | |
| Self-ConsUModel=GPT-OSS 20B2026.06 | 0.871 | 0.694 | |
| Self-ConsUModel=Qwen 3 32B2026.06 | 0.871 | 0.817 | |
| VerbalizedUModel=DeepSeek R12026.06 | 0.87 | 0.603 | |
| StructUModel=GPT-OSS 20B, Aggregation=within2026.06 | 0.869 | 0.582 | |
| StructUModel=DeepSeek R1, Aggregation=total2026.06 | 0.868 | 0.596 | |
| SemanticUModel=GPT-OSS 20B2026.06 | 0.86 | 0.46 | |
| Self-ConsUModel=Amazon Nova Premier2026.06 | 0.86 | 0.839 | |
| StructUModel=Qwen 3 32B, Aggregation=within2026.06 | 0.859 | 0.798 | |
| StructUModel=Amazon Nova Premier, Aggregation=within2026.06 | 0.834 | 0.747 | |
| StructUModel=Qwen 3 32B, Aggregation=total2026.06 | 0.833 | 0.754 | |
| StructUModel=Amazon Nova Premier, Aggregation=total2026.06 | 0.821 | 0.687 | |
| SemanticUModel=Qwen 3 32B2026.06 | 0.819 | 0.717 | |
| SemanticUModel=Amazon Nova Premier2026.06 | 0.81 | 0.695 | |
| SemanticUModel=Claude 4.5 Sonnet2026.06 | 0.783 | 0.72 | |
| StructUModel=Qwen 3 32B, Aggregation=across2026.06 | 0.78 | 0.608 | |
| StructUModel=Amazon Nova Premier, Aggregation=across2026.06 | 0.726 | 0.609 |