Simultaneous Speech Translation on CallHome Spanish-English Es-En (test)
21.3BLEUFast-MD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Fast-MDmode=Offline2024.06 | 21.3 | — | |
| LS-Transducer-SSTAIF epsilon (e)=5, Latency Region=Medium2024.06 | 21.2 | 1.578 | |
| LS-Transducer-SSTAIF epsilon (e)=2, Latency Region=Medium2024.06 | 20.9 | 1.089 | |
| LS-Transducer-SSTAIF epsilon (e)=1, Latency Region=Low2024.06 | 20.8 | 0.912 | |
| Wait-kWait-k parameter=4, Pre-decision step size=360 ms, Latency Region=High2024.06 | 20.2 | 2.073 | |
| LS-Transducer-SSTLatency Region=Low2024.06 | 20.1 | 0.759 | |
| Wait-kWait-k parameter=5, Pre-decision step size=360 ms, Latency Region=High2024.06 | 19.9 | 2.129 | |
| ESPnetmode=Offline2024.06 | 19.4 | — | |
| Wait-kWait-k parameter=3, Pre-decision step size=360 ms, Latency Region=Medium2024.06 | 19.1 | 1.71 | |
| CAATLatency Region=Low2024.06 | 17.7 | 0.965 | |
| Wait-kWait-k parameter=3, Pre-decision step size=280 ms, Latency Region=Medium2024.06 | 17 | 1.388 | |
| Wait-kWait-k parameter=1, Pre-decision step size=280 ms, Latency Region=Medium2024.06 | 15.4 | 1.254 | |
| B-AEDLatency Region=High2024.06 | 15.3 | 3.434 | |
| CIF-ILLatency weight (Alat)=0.0, Latency Region=Medium2024.06 | 13.6 | 1.103 | |
| Wait-kWait-k parameter=3, Pre-decision step size=200 ms, Latency Region=Medium2024.06 | 13.1 | 1.166 | |
| CIF-ILLatency weight (Alat)=0.5, Latency Region=Low2024.06 | 12.6 | 0.942 | |
| Wait-kWait-k parameter=1, Pre-decision step size=200 ms, Latency Region=Low2024.06 | 12.5 | 0.987 | |
| Standard Neural TransducerLatency Region=Medium2024.06 | 12 | 1.443 |