Machine Translation (XX to En) on Flores-200 (test)
88.2COMETX-ALMA-13B (Only SFT, MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| X-ALMA-13B (Only SFT, MoE)# Tokens (Pre-training)=110B, # Params (Base/Adapter)=13B/16B, # Params (Total)=29B2025.02 | 88.2 | |
| X-ALMA-13B-DAT (MoE)# Tokens (Pre-training)=20B, # Params (Base/Adapter)=13B/4B, # Params (Total)=17B2025.02 | 87.6 | |
| X-ALMA-13B-DATM (MoE)# Tokens (Pre-training)=20B, # Params (Base/Adapter)=13B/1B, # Params (Total)=14B2025.02 | 87.4 | |
| Aya-101# Tokens (Pre-training)=null, # Params (Base/Adapter)=13B/-, # Params (Total)=13B2025.02 | 86.3 | |
| LLaMAX3-Alpaca-8B# Tokens (Pre-training)=66B, # Params (Base/Adapter)=8B/-, # Params (Total)=8B2025.02 | 85.9 | |
| Aya-23-35B# Tokens (Pre-training)=null, # Params (Base/Adapter)=35B/-, # Params (Total)=35B2025.02 | 84.9 | |
| Aya-23-8B# Tokens (Pre-training)=null, # Params (Base/Adapter)=8B/-, # Params (Total)=8B2025.02 | 80.9 | |
| NLLB-3.3B# Tokens (Pre-training)=null, # Params (Base/Adapter)=3B/-, # Params (Total)=3B2025.02 | 80.7 |