LLM Self-Consistency Certification on AIME 2026
82.5BonferroniCITE/W-CITE Framework
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=1024, Case=A, Target=mode, temperature=0.7, top_p=0.8, top_k=202026.05 | 82.5 | 94.4 | 94.6 | 95.9 | 79.8 | 25.7 | 113.7 | 113.2 | 57.8 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=1024, Case=A, Target=mode, temperature=0.4, top_p=0.9, top_k=20, reasoning_effort=low2026.05 | 82.5 | 82.9 | 82.9 | 84.8 | 55.4 | 44 | 176.7 | 126.6 | 91 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=512, Case=A, Target=mode, temperature=0.4, top_p=0.9, top_k=20, reasoning_effort=low2026.05 | 79.9 | 81.1 | 81.2 | 83 | 53.8 | 34.8 | 84.2 | 80.7 | 58 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=512, Case=A, Target=mode, temperature=0.7, top_p=0.8, top_k=202026.05 | 77 | 90.2 | 90.6 | 92.9 | 77.9 | 19.9 | 81.8 | 82 | 45.6 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=256, Case=A, Target=mode, temperature=0.4, top_p=0.9, top_k=20, reasoning_effort=low2026.05 | 74 | 76.5 | 77.8 | 79.5 | 51.3 | 25.7 | 62.8 | 60.7 | 40.3 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=256, Case=A, Target=mode, temperature=0.7, top_p=0.8, top_k=202026.05 | 68.3 | 83.3 | 83.8 | 88 | 74.4 | 14.5 | 49.1 | 55.5 | 32.1 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=128, Case=A, Target=mode, temperature=0.4, top_p=0.9, top_k=20, reasoning_effort=low2026.05 | 65.9 | 69.3 | 70.1 | 74.2 | 48.6 | 18.3 | 43.8 | 43.5 | 27.9 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=128, Case=A, Target=mode, temperature=0.7, top_p=0.8, top_k=202026.05 | 59.7 | 78.1 | 78.5 | 82.7 | 70.5 | 10.2 | 32.4 | 33 | 22.5 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=64, Case=A, Target=mode, temperature=0.4, top_p=0.9, top_k=20, reasoning_effort=low2026.05 | 56.3 | 59.6 | 59.9 | 66.6 | 45.9 | 12.6 | 29.3 | 29.6 | 21 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=64, Case=A, Target=mode, temperature=0.7, top_p=0.8, top_k=202026.05 | 49.9 | 72.4 | 72.7 | 77.8 | 67.1 | 7.1 | 21.8 | 22.8 | 15.9 |