Multilingual Language Understanding and Generation on MGSM, XQuAD, X-CSQA, and XLSum (test)
44.6Performance (En)Lang-Spec
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Lang-SpecBase Model=Mistral-7b-v0.1, Fine-tuning Target=Language-specific neurons (MWork), Number of documents=4002024.02 | 44.6 | 34.9 | 28.5 | 23.4 | 16.9 | |
| OriginalBase Model=Mistral-7b-v0.1, Fine-tuning=None2024.02 | 41.1 | 32.7 | 25.6 | 21.7 | 15.1 | |
| RandomBase Model=Mistral-7b-v0.1, Fine-tuning Target=Random neurons, Number of documents=4002024.02 | 40.8 | 32.7 | 25.2 | 21.2 | 15.1 |