Financial Question Answering on FinMMR Medium
67AccuracyQwen3-VL-8B + FINACUMEN
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-VL-8B + FINACUMENGroup=FINACUMEN2026.06 | 67 | |
| Qwen2.5-VL-72BGroup=General LLMs2026.06 | 63.42 | |
| GPTGroup=General LLMs2026.06 | 63.33 | |
| LlamaGroup=General LLMs2026.06 | 63.25 | |
| Claude SonnetGroup=General LLMs2026.06 | 62.25 | |
| Gemini 2.0 FlashGroup=General LLMs2026.06 | 57.83 | |
| Qwen3-VL-8B-InstructGroup=Base2026.06 | 45.75 | |
| FinLLaVAGroup=Financial LLMs2026.06 | 2.75 |