Speech Translation on CoVOST En-X 2 (test)
25.7BLEU (Ar)ZEROSWOT-L (C)
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ZEROSWOT-L (C)Zero-shot=true, Training Parameters (B)=0.35, Inference Parameters (B)=1.65, Model Category=Large-sized2024.02 | 25.7 | 40 | 29 | 32.8 | 27.2 | 26.6 | 37.1 | 47.1 | 25.7 | 18.9 | 33.2 | 39.3 | 25.3 | 19.8 | 40.5 | 31.2 | |
| SEAMLESSM4T-v2Zero-shot=false, Parameters (B)=2.3, Model Category=Large-sized2024.02 | 25.4 | 43.6 | 35.5 | 37 | 29.3 | 19.2 | 40.2 | 39.7 | 24.8 | 16.4 | 36.2 | 43.7 | 23.4 | 24.7 | 35.9 | 31.7 | |
| SEAMLESSM4T-LZero-shot=false, Parameters (B)=2.3, Model Category=Large-sized2024.02 | 24.5 | 41.6 | 33.6 | 35.9 | 28.5 | 19.3 | 39 | 39.4 | 23.8 | 15.7 | 35 | 42.5 | 22.7 | 23.9 | 33.1 | 30.6 | |
| ZEROSWOT-M (C)Zero-shot=true, Training Parameters (B)=0.35, Inference Parameters (B)=0.95, Model Category=Medium-sized2024.02 | 24.4 | 38.7 | 28.8 | 31.2 | 26.2 | 26 | 36 | 46 | 24.8 | 19 | 31.6 | 37.8 | 24.4 | 18.6 | 39 | 30.2 | |
| SEAMLESSM4T-MZero-shot=false, Parameters (B)=1.2, Model Category=Medium-sized2024.02 | 20.8 | 37.3 | 29.9 | 31.4 | 23.3 | 17.2 | 34.8 | 37.5 | 19.5 | 12.9 | 29 | 37.3 | 18.9 | 19.8 | 30 | 26.6 | |
| XLS-R-2BZero-shot=false, Parameters (B)=2.0, Model Category=Large-sized2024.02 | 20.7 | 34.2 | 33.8 | 28.3 | 24.1 | 22.9 | 32.5 | 41.5 | 23.5 | 16.2 | 27.6 | 34.5 | 19.8 | 18.6 | 38.5 | 27.8 | |
| XLS-R-1BZero-shot=false, Parameters (B)=1.0, Model Category=Medium-sized2024.02 | 19.2 | 32.1 | 31.8 | 26.2 | 22.4 | 21.3 | 30.3 | 39.9 | 22 | 14.9 | 25.4 | 32.3 | 18.1 | 17.1 | 36.7 | 26 |