Speech Quality Assessment on S2S-ARENA
73.3Content ScoreHuman–human agreement
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human–human agreementJudge=Human2026.01 | 73.3 | 48.3 | 75 | 75 | |
| Audio JudgeJudge=Audio-only2026.01 | 58.9 | 52.5 | 37.7 | — | |
| TRACEBackbone=Gemini 2.5 Flash, Judge=Tree-based fusion2026.01 | 58 | 51.6 | 48.1 | — | |
| LLM JudgeJudge=Transcript-only2026.01 | 57 | 55.1 | 35.4 | — | |
| Random GuessJudge=Random2026.01 | 25 | 25 | 25 | 25 |