Financial Reasoning on SMFR
96.51AccuracyExpert MAS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Expert MASLLM Backbone=GPT-52026.06 | 96.51 | 554.82 | |
| MAS-OrchestraLLM Backbone=GPT-52026.06 | 62.98 | 909.9 | |
| DyLANLLM Backbone=GPT-52026.06 | 61.28 | 1,189.7 | |
| CoT-SCLLM Backbone=GPT-52026.06 | 56.97 | 478.4 | |
| AFlowLLM Backbone=GPT-52026.06 | 56.86 | 900.9 | |
| MaASLLM Backbone=GPT-52026.06 | 54.48 | 794.7 | |
| CoTLLM Backbone=GPT-52026.06 | 48.53 | 146.9 | |
| Expert MASLLM Backbone=GPT-OSS-120B2026.06 | 36.14 | 5.19 | |
| MAS-ZeroLLM Backbone=GPT-52026.06 | 33.84 | 9,238.85 | |
| DyLANLLM Backbone=GPT-OSS-120B2026.06 | 32.71 | 72.5 | |
| CoT-SCLLM Backbone=GPT-OSS-120B2026.06 | 26.13 | 14.6 | |
| MAS-OrchestraLLM Backbone=GPT-OSS-120B2026.06 | 25.28 | 35 | |
| ADASLLM Backbone=GPT-OSS-120B2026.06 | 23.55 | 24.1 | |
| MaASLLM Backbone=GPT-OSS-120B2026.06 | 23.41 | 23.7 | |
| Expert MASLLM Backbone=GPT-4o2026.06 | 22.56 | 245.13 | |
| CoT-SCLLM Backbone=GPT-4o2026.06 | 22.11 | 169.5 | |
| AFlowLLM Backbone=GPT-OSS-120B2026.06 | 20.29 | 18.4 | |
| ADASLLM Backbone=GPT-52026.06 | 20.24 | 427.2 | |
| CoTLLM Backbone=GPT-4o2026.06 | 20.12 | 43.5 | |
| AFlowLLM Backbone=GPT-4o2026.06 | 19.84 | 293.1 | |
| MAS-OrchestraLLM Backbone=GPT-4o2026.06 | 19.61 | 304 | |
| MaASLLM Backbone=GPT-4o2026.06 | 19.22 | 274.1 | |
| DyLANLLM Backbone=GPT-4o2026.06 | 18.93 | 513.6 | |
| CoTLLM Backbone=GPT-OSS-120B2026.06 | 18.88 | 3.3 | |
| MAS-ZeroLLM Backbone=GPT-OSS-120B2026.06 | 15.82 | 128.08 | |
| ADASLLM Backbone=GPT-4o2026.06 | 14.8 | 123 | |
| MAS-ZeroLLM Backbone=GPT-4o2026.06 | 13.21 | 5,250.34 |