Mathematical Question Answering on MetaMathQA (final)
92.52AccuracyMegaTrain
Evaluation results
| Method | Links | |
|---|---|---|
| MegaTrainModel Scale=14B2026.04 | 92.52 | |
| ZeRO-3 OffloadModel Scale=14B2026.04 | 92.41 | |
| ZeRO InfinityModel Scale=14B2026.04 | 92.36 | |
| MegaTrainModel Scale=7B2026.04 | 88.99 | |
| ZeRO InfinityModel Scale=7B2026.04 | 88.97 | |
| ZeRO-3 OffloadModel Scale=7B2026.04 | 88.93 | |
| PyTorch NativeModel Scale=7B2026.04 | 88.91 | |
| BaselineModel Scale=14B2026.04 | 37.58 | |
| BaselineModel Scale=7B2026.04 | 33.47 |