Financial Knowledge on Finova
67.7AccuracyGPT-5 mini-high
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-5 mini-highReasoning Capability=with Reasoning, Domain Focus=General2026.03 | 67.7 | 77.1 | |
| Qwen3-32BReasoning Capability=without Reasoning, Domain Focus=General2026.03 | 57.4 | 74.7 | |
| Qwen3-4B-ThinkingReasoning Capability=with Reasoning, Domain Focus=General2026.03 | 54.6 | 72.5 | |
| ODA-Fin-RL-8BDomain Focus=Financial2026.03 | 54.6 | 74.6 | |
| Gemini 2.5 Flash-LiteReasoning Capability=with Reasoning, Domain Focus=General2026.03 | 51.2 | 67.7 | |
| ODA-Fin-SFT-8BDomain Focus=Financial2026.03 | 47.8 | 72.1 | |
| Qwen3-8BReasoning Capability=without Reasoning, Domain Focus=General2026.03 | 44.9 | 71.5 | |
| Dianjin-R1-7BDomain Focus=Financial2026.03 | 42.7 | 70.3 | |
| Qwen2.5-7B-InstructReasoning Capability=without Reasoning, Domain Focus=General2026.03 | 42 | 68 | |
| Fin-R1Domain Focus=Financial2026.03 | 38.6 | 61.4 | |
| Llama-3.1-8B-InstructReasoning Capability=without Reasoning, Domain Focus=General2026.03 | 27.7 | 56.9 | |
| Qwen2.5-7BReasoning Capability=without Reasoning, Domain Focus=General2026.03 | 19 | 47.8 | |
| Xuanyuan-6B-ChatDomain Focus=Financial2026.03 | 12.3 | 36.7 | |
| Plutus-8B-InstructDomain Focus=Financial2026.03 | 12.3 | 36.2 |