Engineering Reasoning on MMLU-Pro Engineering
81AccuracyMILES
Evaluation Results
| Method | Links | |
|---|---|---|
| MILESBackbone=Qwen3-30B-Instruct, Inference Strategy=MILES2026.07 | 81 | |
| MILESBackbone=GPT-4.1, Inference Strategy=MILES2026.07 | 80 | |
| SCBackbone=GPT-4.1, Inference Strategy=SC2026.07 | 78.5 | |
| SCBackbone=Qwen3-30B-Instruct, Inference Strategy=SC2026.07 | 78 | |
| ZS-CoTBackbone=GPT-4.1, Inference Strategy=ZS-CoT2026.07 | 75.5 | |
| BoTBackbone=Qwen3-30B-Instruct, Inference Strategy=BoT2026.07 | 75.5 | |
| MILESBackbone=GPT-4.1-mini, Inference Strategy=MILES2026.07 | 75 | |
| ZS-CoTBackbone=Qwen3-30B-Instruct, Inference Strategy=ZS-CoT2026.07 | 74.5 | |
| SCBackbone=GPT-4.1-mini, Inference Strategy=SC2026.07 | 73.5 | |
| DCBackbone=GPT-4.1, Inference Strategy=DC2026.07 | 72 | |
| MILESBackbone=GPT-OSS-20B, Inference Strategy=MILES2026.07 | 71 | |
| BoTBackbone=GPT-4.1-mini, Inference Strategy=BoT2026.07 | 70.5 | |
| SCBackbone=GPT-OSS-20B, Inference Strategy=SC2026.07 | 70 | |
| ZS-CoTBackbone=GPT-OSS-20B, Inference Strategy=ZS-CoT2026.07 | 68.5 | |
| DCBackbone=GPT-4.1-mini, Inference Strategy=DC2026.07 | 67.5 | |
| BoTBackbone=GPT-4.1, Inference Strategy=BoT2026.07 | 67.5 | |
| DCBackbone=GPT-OSS-20B, Inference Strategy=DC2026.07 | 66.5 | |
| ZS-CoTBackbone=GPT-4.1-mini, Inference Strategy=ZS-CoT2026.07 | 65.5 | |
| DCBackbone=Qwen3-30B-Instruct, Inference Strategy=DC2026.07 | 52 | |
| BoTBackbone=GPT-OSS-20B, Inference Strategy=BoT2026.07 | 41.5 |