Financial workflow task execution on RealFin benchmark
68AccuracyBA-Inc
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BA-IncModel=deepseek-v4-pro2026.06 | 68 | 1.59 | 130 | 1.72 | 1.74 | |
| GAModel=Claude Sonnet 4.62026.04 | 65 | 102 | 12 | 114 | 5.7 | |
| GAModel=Claude Sonnet 4.62026.06 | 65 | 102 | 12 | 114 | 5.7 | |
| BA-IncModel=deepseek-v4-flash2026.06 | 65 | 1.89 | 126 | 2.02 | 3.96 | |
| BA-FullModel=deepseek-v4-pro2026.06 | 65 | 3.38 | 323 | 3.7 | 7.02 | |
| Claude CodeModel=Claude Opus 4.62026.04 | 60 | 290 | 17 | 307 | 1.95 | |
| CodexModel=GPT-5.42026.04 | 60 | 838 | 54 | 892 | 0.67 | |
| Claude CodeModel=Claude Opus 4.62026.06 | 60 | 290 | 17 | 307 | 1.95 | |
| CodexModel=GPT-5.42026.06 | 60 | 838 | 54 | 892 | 0.67 | |
| GAModel=deepseek-v4-pro2026.06 | 60 | 3.4 | 317 | 3.72 | 6.46 | |
| Claude CodeModel=Claude Sonnet 4.62026.04 | 55 | 226 | 12 | 238 | 2.31 | |
| Claude CodeModel=Claude Sonnet 4.62026.06 | 55 | 226 | 12 | 238 | 2.31 | |
| BA-FullModel=deepseek-v4-flash2026.06 | 52 | 2.9 | 244 | 3.15 | 6.67 | |
| GAModel=deepseek-v4-flash2026.06 | 45 | 3.98 | 262 | 4.24 | 4.24 | |
| OpenClawModel=Claude Sonnet 4.62026.04 | 35 | 249 | 2 | 251 | 1.39 | |
| OpenClawModel=Claude Sonnet 4.62026.06 | 35 | 249 | 2 | 251 | 1.39 |