Spoken Question Answering on OpenAudioBench S2T
88.89AlpacaEval ScoreFun-Audio-Chat-30B-A3B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Fun-Audio-Chat-30B-A3BLLM Size=30B-A3B, Frame Rate-In=5, Frame Rate-Out=52025.12 | 88.89 | 85 | 75.25 | 76 | 77.8 | 80.59 | |
| GPT-Audio2025.12 | 83.37 | 90.67 | 74.75 | 92.2 | 83.7 | 84.94 | |
| Gemini-2.5-Pro2025.12 | 76.58 | 83 | 80.3 | 90.2 | 80.9 | 82.2 | |
| Longcat-Flash-Omni-InstructLLM Size=560B-A27B, Frame Rate-In=12.5, Frame Rate-Out=16.672025.12 | 75.43 | 83.33 | 79.71 | 86.2 | 76 | 80.13 |