# Mathematical Reasoning on MATH (Normalized Spearman distance) Source: [Mathematical Reasoning on MATH (Normalized Spearman distance)]() Collection index: [llms.txt]() Data updated: 2026-06-17T07:18:19.418Z Evaluation of model performance on the MATH dataset using the Normalized Spearman distance metric. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Mathematical Reasoning | | Dataset (including any stated split) | MATH | | Metric | Normalized Spearman Distance | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Normalized Spearman Distance](): Lower is better; unit: SCALAR. ## Recorded results | Method | Normalized Spearman Distance | Result date | Report paper | | --- | --- | --- | --- | | Trunc50→40 | 13 | Not recorded | 6a3229ffd33dfb23e783ea4a | | SingleGraph1 | 18 | Not recorded | 6a3229ffd33dfb23e783ea4a | | ScoreWin80 | 20 | Not recorded | 6a3229ffd33dfb23e783ea4a | | NoTrunc boot | 21 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Block top-2 | 23 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Random50→40×10 | 24 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Block top-1 | 31 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Trunc25→20 | 31 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Block top-2 | 32 | Not recorded | 6a3229ffd33dfb23e783ea4a | | ScoreWin40 | 37 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Block top-1 | 38 | Not recorded | 6a3229ffd33dfb23e783ea4a | | NoTrunc boot | 43 | Not recorded | 6a3229ffd33dfb23e783ea4a | | Random50→20×10 | 44 | Not recorded | 6a3229ffd33dfb23e783ea4a | | SingleGraph1/all10 | 44 | Not recorded | 6a3229ffd33dfb23e783ea4a | ### Trunc50→40 Normalized Spearman Distance: 13. Result ID: 6a324a23fbc373592c2f637d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### SingleGraph1 Normalized Spearman Distance: 18. Result ID: 6a324a23fbc373592c2f6383. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### ScoreWin80 Normalized Spearman Distance: 20. Result ID: 6a324a23fbc373592c2f6381. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### NoTrunc boot Normalized Spearman Distance: 21. Result ID: 6a324a23fbc373592c2f6380. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### Block top-2 Normalized Spearman Distance: 23. Result ID: 6a324a23fbc373592c2f637e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### Random50→40×10 Normalized Spearman Distance: 24. Result ID: 6a324a23fbc373592c2f6382. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### Block top-1 Normalized Spearman Distance: 31. Result ID: 6a324a23fbc373592c2f637f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Task-prompt"}. This record does not assert independent reproduction. ### Trunc25→20 Normalized Spearman Distance: 31. Result ID: 6a324a23fbc373592c2f6384. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. ### Block top-2 Normalized Spearman Distance: 32. Result ID: 6a324a23fbc373592c2f6385. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. ### ScoreWin40 Normalized Spearman Distance: 37. Result ID: 6a324a23fbc373592c2f6388. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. ### Block top-1 Normalized Spearman Distance: 38. Result ID: 6a324a23fbc373592c2f6386. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. ### NoTrunc boot Normalized Spearman Distance: 43. Result ID: 6a324a23fbc373592c2f6387. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. ### Random50→20×10 Normalized Spearman Distance: 44. Result ID: 6a324a23fbc373592c2f6389. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. ### SingleGraph1/all10 Normalized Spearman Distance: 44. Result ID: 6a324a23fbc373592c2f638a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Perturbation Level":"Judge-prompt with Prometheus"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.