Speech-to-Text Translation on CoVoST2 zh-en
35.21BLEUAudio-Interaction
Evaluation Results
| Method | Links | |
|---|---|---|
| Audio-InteractionSize=3B2026.06 | 35.21 | |
| Qwen3-OmniSize=30B-A3B2026.04 | 29.4 | |
| Qwen2.5-OmniSize=7B2026.06 | 29.4 | |
| MiniCPM-o 4.5Size=9B2026.04 | 26.4 | |
| Qwen2-AudioSize=7B2026.06 | 24.4 | |
| APinlin=✓, ldeep=-, FRR=93.56, Pre. GFLOPs=730.28, FLOPs Ratio=93.51, Setting=Conservative (τin=0.90, τdeep=0.80)2026.04 | 23.06 | |
| Vanillalin=-, ldeep=-, FRR=100.0, Pre. GFLOPs=780.94, FLOPs Ratio=100.0, Setting=N/A2026.04 | 23.02 | |
| APdeeplin=-, ldeep=✓, FRR=14.30, Pre. GFLOPs=718.12, FLOPs Ratio=91.96, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.04 | 23.02 | |
| APdeeplin=-, ldeep=✓, FRR=33.29, Pre. GFLOPs=731.96, FLOPs Ratio=93.73, Setting=Conservative (τin=0.90, τdeep=0.80)2026.04 | 23.01 | |
| DAPlin=✓, ldeep=✓, FRR=33.76, Pre. GFLOPs=686.39, FLOPs Ratio=87.89, Setting=Conservative (τin=0.90, τdeep=0.80)2026.04 | 22.94 | |
| DAPlin=✓, ldeep=✓, FRR=14.91, Pre. GFLOPs=566.30, FLOPs Ratio=72.52, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.04 | 22.78 | |
| APinlin=✓, ldeep=-, FRR=78.64, Pre. GFLOPs=612.93, FLOPs Ratio=78.49, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.04 | 22.69 | |
| Phi-4-multimodalSize=5.6B2026.06 | 22.39 | |
| Kimi-AudioSize=9B2026.04 | 18.3 | |
| Qwen2.5-OmniSize=3B2026.06 | 18.17 | |
| Qwen-Audiozero-shot=true2023.11 | 15.7 | |
| SpeechLLaMATask-specific fine-tuning=true2023.11 | 12.3 |