Role Adherence and Instruction Following on Service-Duplex-Bench
4.6Q0 ScoreGemini
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Gemini2026.01 | 4.6 | 4.7 | 4.8 | 4.9 | 4.5 | 4.7 | 4.9 | 4.73 | |
| PersonaPlex2026.01 | 4.6 | 4.6 | 4.4 | 4.5 | 4.5 | 4.3 | 4.5 | 4.48 | |
| Freeze-Omni2026.01 | 3.9 | 3.5 | 3.8 | 4.3 | 4.1 | 4.2 | 4.3 | 4.02 | |
| Moshi2026.01 | 1.5 | 1.4 | 1.8 | 2 | 1.9 | 2.1 | 1.6 | 1.75 | |
| Qwen-2.5-OmniVAD=Freeze-Omni2026.01 | 1.3 | 1.6 | 2.6 | 3.4 | 3.3 | 3.6 | 3.5 | 2.76 |