Simultaneous Speech Translation on MCIF En-It (dev)
43.56BLEUCanary with AlignAtt
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Canary with AlignAttReg.=high, Inference mode=Simultaneous2026.06 | 43.56 | 68.32 | 0.8227 | 3,282 | |
| baseline organizersReg.=high, Transcript context=ctx2026.06 | 37.76 | 65.77 | 0.7877 | 3,231 | |
| baseline organizersReg.=high, Transcript context=no ctx2026.06 | 37.28 | 65.44 | 0.7806 | 3,300 | |
| CanaryInference mode=Offline2026.06 | 36.78 | 62.22 | 0.7054 | — | |
| Canary sliding windowReg.=high2026.06 | 35.52 | 66.07 | 0.7729 | 2,724 | |
| Canary with AlignAttReg.=low, Inference mode=Simultaneous2026.06 | 34.79 | 62.21 | 0.7618 | 1,972 | |
| baseline organizersReg.=low, Transcript context=ctx2026.06 | 31.45 | 63.03 | 0.696 | 1,735 |