Speech Instruction-Following on VStyle zh 2025
4.1Overall ScoreDoubao
Evaluation Results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Doubao2025.12 | 4.1 | 3.88 | 4.35 | 3.25 | 4.65 | 4.35 | 4.7 | 3.77 | 3.9 | 3.96 | 2.88 | 4.45 | 3.79 | 4.59 | 4.72 | 4.8 | 4.83 | |
| GPT-4o2025.12 | 3.84 | 3.42 | 3.1 | 3.5 | 3.83 | 3.35 | 3.9 | 3.22 | 3.37 | 3.51 | 3.11 | 3.89 | 3.9 | 4.75 | 4.83 | 4.67 | 4.8 | |
| GPT-Audio2025.12 | 3.75 | 3.67 | 3.65 | 4.08 | 4.42 | 3.05 | 4.25 | 3.47 | 3.73 | 4.07 | 3.48 | 3.69 | 3.65 | 3.8 | 3.62 | 4.33 | 3.91 | |
| Fun-Audio-Chat-30B-A3BParameters=30B, Model Identity=A3B2025.12 | 3.68 | 3.42 | 4.47 | 3.26 | 4.08 | 3 | 4.35 | 3.6 | 3.66 | 4.01 | 2.96 | 4.02 | 3.95 | 3.64 | 3.83 | 2.9 | 3.71 | |
| Fun-Audio-Chat-8BParameters=8B2025.12 | 3.46 | 3.5 | 4.2 | 3.08 | 4 | 2.75 | 3.7 | 3.37 | 3.42 | 3.14 | 2.94 | 3.42 | 3.3 | 3.73 | 3.93 | 4.03 | 3.77 | |
| Kimi-Audio2025.12 | 3.11 | 3.33 | 3.45 | 2.25 | 3.75 | 2.95 | 3.25 | 3.17 | 2.66 | 2.74 | 2.43 | 3.01 | 2.23 | 3.86 | 3.86 | 3.8 | 4.57 | |
| Baichuan-Audio2025.12 | 2.25 | 2.67 | 2.45 | 3.08 | 2.29 | 2 | 2.8 | 2.58 | 1.71 | 1.72 | 1.69 | 2.29 | 1.95 | 2.11 | 2.55 | 2.2 | 3.51 |