List your company

Multilingual Language Understanding and Generation on MGSM, XQuAD, X-CSQA, and XLSum (test)

44.6Performance (En)Lang-Spec
40.64841.67442.743.726Feb 29, 2024

Evaluation results

MethodLinks
Lang-SpecBase Model=Mistral-7b-v0.1, Fine-tuning Target=Language-specific neurons (MWork), Number of documents=4002024.0244.634.928.523.416.9
OriginalBase Model=Mistral-7b-v0.1, Fine-tuning=None2024.0241.132.725.621.715.1
RandomBase Model=Mistral-7b-v0.1, Fine-tuning Target=Random neurons, Number of documents=4002024.0240.832.725.221.215.1