Multilingual Proficiency on Multilingual Evaluation
65.5Exam ScoreQwen2-57B-A14B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2-57B-A14BArchitecture=MoE, # Act Params=14B, # Params=57B2024.07 | 65.5 | 77 | 62.3 | 34.5 | |
| Qwen1.5-32BArchitecture=Dense, # Act Params=34B, # Params=34B2024.07 | 61.6 | 76.5 | 56.1 | 33.5 | |
| Yi-1.5-34BArchitecture=Dense, # Act Params=32B, # Params=32B2024.07 | 58.3 | 73.9 | 49.3 | 30 | |
| Mixtral-8x7BArchitecture=MoE, # Act Params=12B, # Params=47B2024.07 | 56.1 | 70.7 | 45 | 29.8 |