Multi-modal Chat on MM-Vet v2 0613 (test)
71.8ScoreProprietary API SOTA (Anthropic, 2024)
Evaluation results
| Method | Links | |
|---|---|---|
| Proprietary API SOTA (Anthropic, 2024)Model Type=Proprietary API, Evaluation Protocol=Open2025.01 | 71.8 | |
| Open-Source SOTA (Chen et al., 2024d)Model Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 58.1 | |
| IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 54.8 | |
| IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 45.8 |