# Mathematical Reasoning on MATH 500 (∆Acc, CR) Source: [Mathematical Reasoning on MATH 500 (∆Acc, CR)]() Collection index: [llms.txt]() Data updated: 2026-04-09T23:38:03.330Z Evaluation of model performance on mathematical reasoning problems using the MATH 500 dataset, reporting change in accuracy (∆Acc) and completion rate (CR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | MATH 500 | | Metric | Completion Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 11 of 11 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Completion Rate](): Higher is better; unit: PERCENT. - [∆ Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Completion Rate | Result date | Report paper | | --- | --- | --- | --- | | Vanilla | 100 | Not recorded | 69d7327f7d0172140ec76af9 | | Vanilla | 100 | Not recorded | 69d7327f7d0172140ec76af9 | | Dynasor-CoT | 72 | Not recorded | 69d7327f7d0172140ec76af9 | | DEER-PRo | 72 | Not recorded | 69d7327f7d0172140ec76af9 | | DEER | 69 | Not recorded | 69d7327f7d0172140ec76af9 | | TCC | 61 | Not recorded | 69d7327f7d0172140ec76af9 | | DEER-PRo | 45 | Not recorded | 69d7327f7d0172140ec76af9 | | DEER | 41 | Not recorded | 69d7327f7d0172140ec76af9 | | BAEE | 32 | Not recorded | 69d7327f7d0172140ec76af9 | | BAEE | 28 | Not recorded | 69d7327f7d0172140ec76af9 | | NoThinking | 27 | Not recorded | 69d7327f7d0172140ec76af9 | ### Vanilla Completion Rate: 100. Result ID: 69d8376f47f34ce924bffeab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"—","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. ### Vanilla Completion Rate: 100. Result ID: 69d8376f47f34ce924bffeb2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"—","Base Model":"QwQ-32B (DEER) / Qwen3-32B-Think (ours)"}. This record does not assert independent reproduction. ### Dynasor-CoT Completion Rate: 72. Result ID: 69d8376f47f34ce924bffeae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"black-box","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. ### DEER-PRo Completion Rate: 72. Result ID: 69d8376f47f34ce924bffeb4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"semi-white","Base Model":"QwQ-32B (DEER) / Qwen3-32B-Think (ours)"}. This record does not assert independent reproduction. ### DEER Completion Rate: 69. Result ID: 69d8376f47f34ce924bffeb3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"semi-white","Base Model":"QwQ-32B (DEER) / Qwen3-32B-Think (ours)"}. This record does not assert independent reproduction. ### TCC Completion Rate: 61. Result ID: 69d8376f47f34ce924bffead. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"black-box","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. ### DEER-PRo Completion Rate: 45. Result ID: 69d8376f47f34ce924bffeb0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"semi-white","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. ### DEER Completion Rate: 41. Result ID: 69d8376f47f34ce924bffeaf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"semi-white","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. ### BAEE Completion Rate: 32. Result ID: 69d8376f47f34ce924bffeb1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"black-box","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. ### BAEE Completion Rate: 28. Result ID: 69d8376f47f34ce924bffeb5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"black-box","Base Model":"QwQ-32B (DEER) / Qwen3-32B-Think (ours)"}. This record does not assert independent reproduction. ### NoThinking Completion Rate: 27. Result ID: 69d8376f47f34ce924bffeac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Access":"black-box","Base Model":"Qwen3-14B (DEER) / Qwen3-8B-Think (ours)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.