Multi-modal Chat on MM-MT (val)
7.72ScoreProprietary API SOTA (Hurst et al., 2024)
Evaluation results
| Method | Links | |
|---|---|---|
| Proprietary API SOTA (Hurst et al., 2024)Model Type=Proprietary API, Evaluation Protocol=Open2025.01 | 7.72 | |
| IXC-2.5-ChatModel Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 5.7 | |
| Open-Source SOTA (Wang et al., 2024d)Model Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 5.45 | |
| IXC-2.5Model Type=Open-Source (<10B), Evaluation Protocol=Open2025.01 | 3.85 |