Visual Question Answering on OCRBench (test)
89.4ScoreProprietary API SOTA (SenseTime, 2024)
Evaluation results
| Method | Links | |
|---|---|---|
| Proprietary API SOTA (SenseTime, 2024)Model Type=Proprietary API, Evaluation Protocol=VQA2025.01 | 89.4 | |
| Open-Source SOTA (Chen et al., 2024d)Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 82.2 | |
| IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 70 | |
| IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=VQA2025.01 | 69 |