Multi-task Agent Execution on HiMA-Ecom (test)
98Math ScoreDeepSeek-R1
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DeepSeek-R1Model Type=Open-source2025.06 | 98 | 34.7 | 19.3 | 72.4 | 5.3 | 45.9 | |
| DeepSeek-V3Model Type=Open-source2025.06 | 95.7 | 32.3 | 6.3 | 77.2 | 3 | 42.9 | |
| GPT-4oModel Type=Closed-source2025.06 | 84.3 | 35 | 50.3 | 76.2 | 5 | 50.2 | |
| Qwen2.5-14BParameter Count=14B, Model Type=Open-source2025.06 | 80 | 30.3 | 0.3 | 43 | 2 | 31.2 | |
| Qwen2.5-32BParameter Count=32B, Model Type=Open-source2025.06 | 71 | 34.2 | 3 | 68.9 | 1.7 | 35.8 | |
| HiMA-R1Parameter Count=3B+3B, Training Strategy=R12025.06 | 70 | 20.7 | 48.3 | 73.9 | 7 | 44 | |
| HiMA-SFTParameter Count=7B+3B, Training Strategy=SFT2025.06 | 65 | 19.3 | 39.3 | 63.5 | 5 | 38.4 |