Engineering problem-solving on EngiBench Level 3
68.5SC RS ScoreSci-Mind
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Sci-MindBackbone=DeepSeek-R12026.03 | 68.5 | 92.5 | 64.2 | 90 | 71 | 95 | 67.9 | |
| Sci-MindBackbone=GPT-4o2026.03 | 63.8 | 90 | 58.5 | 85 | 66.2 | 92.5 | 62.8 | |
| MM-AgentBackbone=DeepSeek-R12026.03 | 56.8 | 77.5 | 52.4 | 72.5 | 59.2 | 80 | 56.1 | |
| MM-AgentBackbone=GPT-4o2026.03 | 51.3 | 72.5 | 46.8 | 65 | 54 | 75 | 50.7 | |
| Direct PromptingBackbone=DeepSeek-R12026.03 | 34.2 | 42.5 | 30.8 | 37.5 | 38.5 | 47.5 | 34.5 | |
| Direct PromptingBackbone=GPT-4o2026.03 | 28.4 | 35 | 24.1 | 30 | 31.7 | 40 | 28.1 |