# Scientific Reasoning on FrontierSci-Olympiad

Source: [Scientific Reasoning on FrontierSci-Olympiad](<https://www.sota2.com/research/sota/scientific-reasoning-on-frontiersci-olympiad>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-18T06:51:21.704Z

Evaluation of model performance on scientific reasoning questions derived from the FrontierSci-Olympiad dataset, measured using the avg@8 metric.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | scientific reasoning |
| Dataset (including any stated split) | FrontierSci-Olympiad |
| Metric | Avg@8 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Avg@8](<https://www.sota2.com/research/sota/scientific-reasoning-on-frontiersci-olympiad.md?metric=Avg%408>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Avg@8 | Result date | Report paper |
| --- | --- | --- | --- |
| MiroThinker-H1 | 79 | Not recorded | 69ba316f0636e5bf4afc063b |
| GPT-5.2-high | 77.1 | Not recorded | 69ba316f0636e5bf4afc063b |
| Gemini-3-Pro | 76.1 | Not recorded | 69ba316f0636e5bf4afc063b |
| Seed-2.0-Pro | 74 | Not recorded | 69ba316f0636e5bf4afc063b |
| MiroThinker-1.7 | 71.5 | Not recorded | 69ba316f0636e5bf4afc063b |
| Claude-4.5-Opus | 71.4 | Not recorded | 69ba316f0636e5bf4afc063b |
| MiroThinker-1.7-mini | 67.9 | Not recorded | 69ba316f0636e5bf4afc063b |
| Qwen3.5-397B | 60.6 | Not recorded | 69ba316f0636e5bf4afc063b |

### MiroThinker-H1

Avg@8: 79. Result ID: 69ba49ce47f34ce924a38363.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GPT-5.2-high

Avg@8: 77.1. Result ID: 69ba49ce47f34ce924a3835e.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Gemini-3-Pro

Avg@8: 76.1. Result ID: 69ba49ce47f34ce924a38360.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Seed-2.0-Pro

Avg@8: 74. Result ID: 69ba49ce47f34ce924a3835d.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MiroThinker-1.7

Avg@8: 71.5. Result ID: 69ba49ce47f34ce924a38362.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Claude-4.5-Opus

Avg@8: 71.4. Result ID: 69ba49ce47f34ce924a3835f.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MiroThinker-1.7-mini

Avg@8: 67.9. Result ID: 69ba49ce47f34ce924a38361.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen3.5-397B

Avg@8: 60.6. Result ID: 69ba49ce47f34ce924a3835c.

[Reporting paper](<https://www.sota2.com/research/paper/69ba316f0636e5bf4afc063b.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Internal evaluation"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
