LLM Self-Consistency Certification on FrontierScience Olympiad
53Bonferroni ScoreCITE/W-CITE Framework
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=1024, Case=A, Target=mode2026.05 | 53 | 56.3 | 56.7 | 63.3 | 28.1 | 160 | 436.1 | 439.2 | 138.5 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=512, Case=A, Target=mode2026.05 | 42.9 | 44.9 | 45.3 | 53.6 | 24.5 | 112.9 | 195.5 | 193.5 | 97 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=1024, Case=A, Target=mode2026.05 | 42.9 | 47.5 | 42.8 | 55.9 | 20 | 250.3 | 494.7 | 499.9 | 24.3 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=256, Case=A, Target=mode2026.05 | 35 | 35.6 | 35.9 | 44.3 | 19.8 | 73.7 | 110 | 112 | 60.6 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=512, Case=A, Target=mode2026.05 | 34 | 38.2 | 24.2 | 44.6 | 20 | 172 | 258.7 | 319 | 24.3 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=128, Case=A, Target=mode2026.05 | 31.2 | 31.5 | 31.5 | 37.3 | 14.6 | 46 | 65.5 | 64.3 | 35.9 | |
| CITE/W-CITE FrameworkModel=Qwen3-30B, N=64, Case=A, Target=mode2026.05 | 28.4 | 28.8 | 28.9 | 32.8 | 12.1 | 28 | 37.9 | 40.9 | 22.9 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=256, Case=A, Target=mode2026.05 | 23.7 | 26.9 | 20.1 | 33 | 20 | 108.5 | 144.6 | 108.9 | 24.3 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=128, Case=A, Target=mode2026.05 | 20.5 | 21.3 | 18.8 | 25.5 | 19.9 | 65.1 | 67.6 | 40.4 | 24 | |
| CITE/W-CITE FrameworkModel=gpt-oss-20b, N=64, Case=A, Target=mode2026.05 | 19.3 | 18.7 | 14.7 | 20.9 | 19.2 | 37.8 | 32.3 | 28.7 | 22.1 |