Machine Translation (En to XX) on WMT23 (test)
85.6COMETX-ALMA-13B (Only SFT, MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| X-ALMA-13B (Only SFT, MoE)# Tokens (Pre-training)=110B, # Params (Base/Adapter)=13B/16B, # Params (Total)=29B2025.02 | 85.6 | |
| X-ALMA-13B-DAT (MoE)# Tokens (Pre-training)=20B, # Params (Base/Adapter)=13B/4B, # Params (Total)=17B2025.02 | 84.8 | |
| X-ALMA-13B-DATM (MoE)# Tokens (Pre-training)=20B, # Params (Base/Adapter)=13B/1B, # Params (Total)=14B2025.02 | 84.8 | |
| Aya-23-8B# Tokens (Pre-training)=null, # Params (Base/Adapter)=8B/-, # Params (Total)=8B2025.02 | 84.2 | |
| Aya-23-35B# Tokens (Pre-training)=null, # Params (Base/Adapter)=35B/-, # Params (Total)=35B2025.02 | 84.1 | |
| NLLB-3.3B# Tokens (Pre-training)=null, # Params (Base/Adapter)=3B/-, # Params (Total)=3B2025.02 | 81.5 | |
| Aya-101# Tokens (Pre-training)=null, # Params (Base/Adapter)=13B/-, # Params (Total)=13B2025.02 | 80.8 | |
| LLaMAX3-Alpaca-8B# Tokens (Pre-training)=66B, # Params (Base/Adapter)=8B/-, # Params (Total)=8B2025.02 | 79.8 |