# mule

Source: [mule](<https://www.sota2.com/research/dataset/mule>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Mathematical Reasoning on SIMULEQ](<https://www.sota2.com/research/sota/mathematical-reasoning-on-simuleq.md>): Mathematical Reasoning; SIMULEQ.

- [Mathematical Reasoning on GSM8K, MATH, SVAMP, SimulEq, AQuA, SAT, MMLU](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm8k-math-svamp-simuleq-aqua-sat-mmlu.md>): Mathematical Reasoning; Mathematical Reasoning Suite GSM8K, MATH, SVAMP, SimulEq, AQuA, SAT, MMLU.

- [Mathematical Reasoning on SimulEq out-of-domain (test)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-simuleq-out-of-domain-test.md>): Mathematical Reasoning; SimulEq out-of-domain (test).

- [Mathematical Reasoning on Math Reasoning Out-domain (SVAMP, Mathematics, SimulEq) (test)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-math-reasoning-out-domain-svamp-mathematics-simuleq-test.md>): Mathematical Reasoning; Math Reasoning Out-domain (SVAMP, Mathematics, SimulEq) (test).

- [Story Point Estimation on mulestudio](<https://www.sota2.com/research/sota/story-point-estimation-on-mulestudio.md>): Story Point Estimation; mulestudio.

- [Story Point Estimation on mule](<https://www.sota2.com/research/sota/story-point-estimation-on-mule.md>): Story Point Estimation; mule.

- [Energy and force prediction on Guaranteed non-local cumulene Out-of-Domain nc 15 16 (test)](<https://www.sota2.com/research/sota/energy-and-force-prediction-on-guaranteed-non-local-cumulene-out-of-domain-nc-15-16-test.md>): Energy and force prediction; Guaranteed non-local cumulene Out-of-Domain nc 15 16 (test).

- [Energy and force prediction on Guaranteed non-local cumulene Out-of-Domain nc 11 12 (test)](<https://www.sota2.com/research/sota/energy-and-force-prediction-on-guaranteed-non-local-cumulene-out-of-domain-nc-11-12-test.md>): Energy and force prediction; Guaranteed non-local cumulene Out-of-Domain nc 11 12 (test).

- [Energy and force prediction on Guaranteed non-local cumulene In-Domain, nc 3-10, 13, 14 (test)](<https://www.sota2.com/research/sota/energy-and-force-prediction-on-guaranteed-non-local-cumulene-in-domain-nc-3-10-13-14-test.md>): Energy and force prediction; Guaranteed non-local cumulene In-Domain, nc 3-10, 13, 14 (test).

- [Energy and force prediction on Guaranteed non-local cumulene nc 3-10, 13, 14 (train)](<https://www.sota2.com/research/sota/energy-and-force-prediction-on-guaranteed-non-local-cumulene-nc-3-10-13-14-train.md>): Energy and force prediction; Guaranteed non-local cumulene nc 3-10, 13, 14 (train).

- [Math Reasoning on NumGLUE, MMLU-Math, GSM8K, SVAMP, SimulEq, DeepMind, AQuA, SAT](<https://www.sota2.com/research/sota/math-reasoning-on-numglue-mmlu-math-gsm8k-svamp-simuleq-deepmind-aqua-sat.md>): Math Reasoning; Math-Reasoning Evaluation Suite (NumGLUE, MMLU-Math, GSM8K, SVAMP, SimulEq, DeepMind, AQuA, SAT).
