Chartered Accountancy Subject Examination on CA-Ben Intermediate level
46.66Accuracy (I1: Adv. Accounting)GPT-4o
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-4o2026.04 | 46.66 | 73.33 | 20 | 20 | 86.66 | 75 | |
| Microsoft Phi 42026.04 | 46.66 | 46.66 | 33.33 | 33.33 | 66.66 | 68.75 | |
| MISTRAL Large2026.04 | 41.66 | 53.33 | 31.25 | 20 | 73.33 | 60 | |
| CA-ThinkFlow2026.04 | 40 | 33.33 | 33.33 | 40 | 66.67 | 75 | |
| LLAMA 3.1 405B Inst.Parameters=405B, Model Type=Instruct2026.04 | 40 | 53.33 | 20 | 40 | 86.66 | 56.25 | |
| 14B-Deepseek-R1Parameters=14B2026.04 | 33.33 | 33.33 | 20 | 20 | 46.67 | 56.25 | |
| LLAMA 3.3 70B Inst.Parameters=70B, Model Type=Instruct2026.04 | 33.33 | 60 | 40 | 40 | 73.33 | 75 | |
| Claude 3.5 Sonnet2026.04 | 33.33 | 60 | 20 | 46.66 | 93.33 | 75 |