Multi-modal Chat on MIA (val)
88.6ScoreProprietary API SOTA (Hurst et al., 2024)
Evaluation results
| Method | Links | |
|---|---|---|
| Proprietary API SOTA (Hurst et al., 2024)Model Type=Proprietary API, Evaluation Protocol=Open2025.01 | 88.6 | |
| IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 84 | |
| Open-Source SOTA (Wang et al., 2024d)Model Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 80.7 | |
| IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 80.4 |