# Mathematical Reasoning on OlympiadBench (Avg@16, Pass@16) Source: [Mathematical Reasoning on OlympiadBench (Avg@16, Pass@16)]() Collection index: [llms.txt]() Data updated: 2026-06-09T10:54:26.340Z Evaluation of model performance on mathematical reasoning problems using the OlympiadBench dataset, measured by Avg@16 and Pass@16 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | OlympiadBench | | Metric | Avg@16 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg@16](): Higher is better; unit: PERCENT. - [Pass@16](): Higher is better; unit: PERCENT. ## Recorded results | Method | Avg@16 | Result date | Report paper | | --- | --- | --- | --- | | PriFT-mass | 36.36 | Not recorded | 6a279e5f90966ade919bfab6 | | PriFT-prob | 36.14 | Not recorded | 6a279e5f90966ade919bfab6 | | PriFT-mass | 35.75 | Not recorded | 6a279e5f90966ade919bfab6 | | TALR | 34.71 | Not recorded | 6a279e5f90966ade919bfab6 | | DFT | 34.5 | Not recorded | 6a279e5f90966ade919bfab6 | | PriFT-prob | 34.2 | Not recorded | 6a279e5f90966ade919bfab6 | | ASFT | 33.95 | Not recorded | 6a279e5f90966ade919bfab6 | | DFT | 33.34 | Not recorded | 6a279e5f90966ade919bfab6 | | IDFT | 33.2 | Not recorded | 6a279e5f90966ade919bfab6 | | ASFT | 32.41 | Not recorded | 6a279e5f90966ade919bfab6 | | IDFT | 31.71 | Not recorded | 6a279e5f90966ade919bfab6 | | TALR | 31.7 | Not recorded | 6a279e5f90966ade919bfab6 | | Original | 27.23 | Not recorded | 6a279e5f90966ade919bfab6 | | SFT | 19 | Not recorded | 6a279e5f90966ade919bfab6 | | EAFT | 18.9 | Not recorded | 6a279e5f90966ade919bfab6 | | EAFT | 18.85 | Not recorded | 6a279e5f90966ade919bfab6 | | SFT | 18.79 | Not recorded | 6a279e5f90966ade919bfab6 | | Original | 17.66 | Not recorded | 6a279e5f90966ade919bfab6 | ### PriFT-mass Avg@16: 36.36. Result ID: 6a27f090fbc373592c258edd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### PriFT-prob Avg@16: 36.14. Result ID: 6a27f090fbc373592c258ed3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### PriFT-mass Avg@16: 35.75. Result ID: 6a27f090fbc373592c258ed4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### TALR Avg@16: 34.71. Result ID: 6a27f090fbc373592c258ed1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### DFT Avg@16: 34.5. Result ID: 6a27f090fbc373592c258ece. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### PriFT-prob Avg@16: 34.2. Result ID: 6a27f090fbc373592c258edc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### ASFT Avg@16: 33.95. Result ID: 6a27f090fbc373592c258ed2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### DFT Avg@16: 33.34. Result ID: 6a27f090fbc373592c258ed7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### IDFT Avg@16: 33.2. Result ID: 6a27f090fbc373592c258ed9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### ASFT Avg@16: 32.41. Result ID: 6a27f090fbc373592c258edb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### IDFT Avg@16: 31.71. Result ID: 6a27f090fbc373592c258ed0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### TALR Avg@16: 31.7. Result ID: 6a27f090fbc373592c258eda. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### Original Avg@16: 27.23. Result ID: 6a27f090fbc373592c258ed5. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### SFT Avg@16: 19. Result ID: 6a27f090fbc373592c258ed6. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### EAFT Avg@16: 18.9. Result ID: 6a27f090fbc373592c258ed8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen3-Base (8B)"}. This record does not assert independent reproduction. ### EAFT Avg@16: 18.85. Result ID: 6a27f090fbc373592c258ecf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### SFT Avg@16: 18.79. Result ID: 6a27f090fbc373592c258ecd. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. ### Original Avg@16: 17.66. Result ID: 6a27f090fbc373592c258ecc. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-Math (7B)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.