Mathematical Error Detection on Mathematical Error Detection (test)
0.42NMSEMENTATBasic Prompt
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MENTATBasic PromptLM=GPT-5, Training Size=5002025.08 | 0.42 | 0.78 | |
| MENTAT-AvgLM=GPT-5, Training Size=5002025.08 | 0.51 | 0.75 | |
| MENTATBasic PromptLM=GPT-5, Training Size=1002025.08 | 0.52 | 0.72 | |
| MENTAT PromptLM=GPT-5, Training Size=5002025.08 | 0.58 | 0.72 | |
| MENTAT-AvgLM=GPT-5, Training Size=1002025.08 | 0.59 | 0.68 | |
| GEPALM=GPT-5, Training Size=5002025.08 | 0.63 | 0.69 | |
| MENTAT PromptLM=GPT-5, Training Size=1002025.08 | 0.66 | 0.66 | |
| MENTATBasic PromptLM=GPT-4.1, Training Size=5002025.08 | 0.76 | 0.49 | |
| Basic PromptLM=GPT-5, Training Size=1002025.08 | 0.77 | 0.66 | |
| Basic PromptLM=GPT-5, Training Size=5002025.08 | 0.77 | 0.66 | |
| Detailed PromptLM=GPT-5, Training Size=1002025.08 | 0.78 | 0.69 | |
| Detailed PromptLM=GPT-5, Training Size=5002025.08 | 0.78 | 0.69 | |
| GEPALM=GPT-5, Training Size=1002025.08 | 0.78 | 0.68 | |
| MENTATBasic PromptLM=GPT-4.1, Training Size=1002025.08 | 0.87 | 0.51 | |
| MENTAT-AvgLM=GPT-4.1, Training Size=1002025.08 | 1 | 0.52 | |
| Gradient DescentLM=NeoBERT, Training Size=5002025.08 | 1.01 | 0.06 | |
| MENTAT-AvgLM=GPT-4.1, Training Size=5002025.08 | 1.01 | 0.52 | |
| GEPALM=GPT-4.1, Training Size=5002025.08 | 1.01 | 0.54 | |
| GEPALM=GPT-4.1, Training Size=1002025.08 | 1.04 | 0.49 | |
| Gradient DescentLM=NeoBERT, Training Size=1002025.08 | 1.05 | 0.02 | |
| Detailed PromptLM=GPT-4.1, Training Size=1002025.08 | 1.13 | 0.52 | |
| Detailed PromptLM=GPT-4.1, Training Size=5002025.08 | 1.13 | 0.52 | |
| MENTAT PromptLM=GPT-4.1, Training Size=5002025.08 | 1.29 | 0.48 | |
| MENTAT PromptLM=GPT-4.1, Training Size=1002025.08 | 1.39 | 0.45 | |
| Basic PromptLM=GPT-4.1, Training Size=1002025.08 | 1.59 | 0.36 | |
| Basic PromptLM=GPT-4.1, Training Size=5002025.08 | 1.59 | 0.36 |