Chat Benchmark on AIR-Bench
7.54Score (Speech Domain)Whisper+GPT-4
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Whisper+GPT-42025.02 | 7.54 | — | — | — | — | |
| Baichuan-omniParameters=7B2024.10 | 7.42 | 7.26 | 6.12 | 5.76 | — | |
| Qwen2-Audio-InstructParameters=7B2024.10 | 7.18 | 6.99 | 6.79 | 6.77 | — | |
| Qwen2-Audio2025.02 | 7.18 | 6.99 | 6.79 | 6.77 | 6.93 | |
| Qwen-Audio Turbo2025.02 | 7.04 | 6.59 | 5.98 | 5.77 | 6.34 | |
| Soundwave2025.02 | 6.41 | 5.33 | 5.1 | 4.98 | 5.46 | |
| VITAParameters=8x7B2024.10 | 6.4 | 6.59 | 6.59 | 5.94 | — | |
| BLSP2025.02 | 6.17 | 5.55 | 5.08 | 4.52 | 5.33 | |
| SALMONN2025.02 | 6.16 | 6.28 | 5.95 | 6.08 | 6.11 | |
| NEXT-GPT2025.02 | 3.86 | 4.76 | 4.18 | 2.92 | 4.13 | |
| PandaGPT2025.02 | 3.58 | 5.46 | 5.06 | 2.93 | 4.25 |