Open-ended Instruction Following on Audio-OpenHermes
4.44EN ScoreSEA-LION-v3-8B-IT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SEA-LION-v3-8B-ITApproach category=Text-only reference2026.03 | 4.44 | 3.85 | |
| Ours (hard-gating)Approach category=Distilled end-to-end, Gating strategy=hard-gating2026.03 | 4.42 | 3.66 | |
| Ours (soft-gating)Approach category=Distilled end-to-end, Gating strategy=soft-gating2026.03 | 4.29 | 3.58 | |
| Whisper-v3 + SEA-LION-v3-8B-ITApproach category=Cascaded2026.03 | 4.17 | 3.61 | |
| MERaLiON-2-10BApproach category=Zero-shot end-to-end2026.03 | 4.06 | 3.06 | |
| ML-DiVAApproach category=Distilled end-to-end, Training protocol=re-trained baseline2026.03 | 4.03 | 3.11 | |
| Glm-4-voiceApproach category=Zero-shot end-to-end2026.03 | 3.72 | — | |
| Qwen2-AudioApproach category=Zero-shot end-to-end2026.03 | 3.65 | — | |
| SeaLLMs-AudioApproach category=Zero-shot end-to-end2026.03 | 3.37 | 3.27 | |
| EN-DiVAApproach category=Distilled end-to-end, Training protocol=re-trained baseline2026.03 | 3.28 | — |