Financial numerical reasoning on DocMath Simplong (test)
70AccuracyMOCA-AGENT
Evaluation results
| Method | Links | |
|---|---|---|
| MOCA-AGENTBackbone=Qwen3.6-27B, Type=Open-source LLMs2026.06 | 70 | |
| GPT-4oType=Proprietary LLMs2026.06 | 60 | |
| GPT-o3-miniType=Proprietary LLMs2026.06 | 59 | |
| GPT-4.5Type=Proprietary LLMs2026.06 | 59 | |
| Qwen2.5-72BType=Open-source LLMs2026.06 | 59 | |
| GPT-o1-previewType=Proprietary LLMs2026.06 | 56 | |
| Qwen2.5-32BType=Open-source LLMs2026.06 | 56 | |
| Fino1-7BType=Open-source LLMs2026.06 | 56 | |
| Fino1-14BType=Open-source LLMs2026.06 | 55 | |
| Llama-3.3-70BType=Open-source LLMs2026.06 | 54 | |
| DeepSeek-V3Type=Proprietary LLMs2026.06 | 53 | |
| DeepSeek-R1Type=Proprietary LLMs2026.06 | 53 | |
| DS-R1-Distill-Llama-70BType=Open-source LLMs2026.06 | 53 | |
| Qwen3-32BType=Open-source LLMs2026.06 | 51 |