Financial Reasoning on DM-Complong
50.67AccuracyMOCA-AGENT
Evaluation Results
| Method | Links | |
|---|---|---|
| MOCA-AGENT2026.06 | 50.67 | |
| MOCA-AGENTBackbone=Qwen3.6-27B, Type=Open-source LLMs2026.06 | 50.67 | |
| DeepSeek-V32026.06 | 42.33 | |
| DeepSeek-V3Type=Proprietary LLMs2026.06 | 42.33 | |
| GPT-4o2026.06 | 39.33 | |
| GPT-4.52026.06 | 39.33 | |
| GPT-4oType=Proprietary LLMs2026.06 | 39.33 | |
| GPT-4.5Type=Proprietary LLMs2026.06 | 39.33 | |
| DeepSeek-R12026.06 | 38.67 | |
| DeepSeek-R1Type=Proprietary LLMs2026.06 | 38.67 | |
| GPT-o1-preview2026.06 | 36.67 | |
| GPT-o1-previewType=Proprietary LLMs2026.06 | 36.67 | |
| GPT-o3-mini2026.06 | 35 | |
| GPT-o3-miniType=Proprietary LLMs2026.06 | 35 | |
| Llama-3.1-70B-InstructSize=70B2026.06 | 34.33 | |
| Llama-3.3-70B-InstructSize=70B2026.06 | 32 | |
| Llama-3.3-70BType=Open-source LLMs2026.06 | 32 | |
| DeepSeek-R1-Distill-Llama-70B2026.06 | 30.67 | |
| DS-R1-Distill-Llama-70BType=Open-source LLMs2026.06 | 30.67 | |
| Qwen2.5-32B-InstructSize=32B2026.06 | 30 | |
| Qwen2.5-32BType=Open-source LLMs2026.06 | 30 | |
| Fino1-14BSize=14B2026.06 | 27.33 | |
| Fino1-14BType=Open-source LLMs2026.06 | 27.33 | |
| Qwen2.5-14B-InstructSize=14B2026.06 | 26.67 | |
| Fino1-8BSize=8B2026.06 | 26.33 | |
| Fino1-7BType=Open-source LLMs2026.06 | 26.33 | |
| Qwen3-32BSize=32B2026.06 | 26 | |
| Qwen3-32BType=Open-source LLMs2026.06 | 26 | |
| DeepSeek-R1-Distill-Qwen-32B2026.06 | 24.67 | |
| S1-32BSize=32B2026.06 | 24 | |
| Qwen3-14BSize=14B2026.06 | 24 | |
| DeepSeek-R1-Distill-Qwen-14B2026.06 | 21 | |
| QwQ-32BSize=32B2026.06 | 20 | |
| Qwen2.5-7B-InstructSize=7B2026.06 | 17.67 | |
| Qwen3-8BSize=8B2026.06 | 17.67 | |
| DeepSeek-R1-Distill-Llama-8B2026.06 | 15.67 | |
| Limo2026.06 | 15.33 | |
| Qwen2.5-72B-InstructSize=72B2026.06 | 14.67 | |
| Dianjin-R1-7BSize=7B2026.06 | 14.67 | |
| Qwen2.5-72BType=Open-source LLMs2026.06 | 14.67 | |
| Llama-3.1-8B-InstructSize=8B2026.06 | 14.3 | |
| Llama-3-70B-InstructSize=70B2026.06 | 13.67 | |
| FinR1-7BSize=7B2026.06 | 13.67 | |
| Llama-3-8B-InstructSize=8B2026.06 | 6 | |
| Qwen2.5-Math-72B-InstructSize=72B2026.06 | 5 | |
| Llama-4-Scout2026.06 | 0.67 |