Multilingual Instruction Tuning on Multilingual Instruction-Tuning (test)
35.3ROUGE-L (EN)Local FT (multilingual)
Evaluation results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Local FT (multilingual)Training Setting=Local FT (multilingual)2026.03 | 35.3 | 90.5 | 25.8 | 88.6 | 22.3 | 88.5 | 26 | 88.6 | 23.1 | 88.7 | 20.3 | 87.8 | 21.7 | 88 | 14.7 | 86.5 | 23.7 | 88.4 | 0.059 | 0.0112 | |
| Local FT (EN)Training Setting=Local FT (EN)2026.03 | 35.1 | 90.3 | 23.2 | 88.2 | 18.7 | 87.6 | 23.3 | 87.8 | 18.6 | 87.5 | 13.1 | 86.9 | 14.7 | 86.3 | 10.5 | 85.2 | 19.7 | 87.5 | 0.0773 | 0.0149 | |
| FedAvg (15% mono)Training Setting=FedAvg (15% mono)2026.03 | 34.1 | 90.2 | 24.2 | 88.2 | 20.6 | 88.1 | 24.7 | 88.3 | 21.1 | 88.3 | 19.4 | 87.3 | 19.7 | 87.5 | 12.7 | 85.8 | 22.1 | 88 | 0.0609 | 0.0122 | |
| FedAvg (50% mono)Training Setting=FedAvg (50% mono)2026.03 | 33.9 | 90.1 | 23.8 | 88.2 | 21 | 88.1 | 24.3 | 88.1 | 21.1 | 88.3 | 17.9 | 87.3 | 19.5 | 87.4 | 12.1 | 85.7 | 21.7 | 87.9 | 0.0623 | 0.0123 | |
| FedAvg (30% mono)Training Setting=FedAvg (30% mono)2026.03 | 33.7 | 90.1 | 24.4 | 88.2 | 20.6 | 88.1 | 25.1 | 88.3 | 20.8 | 88.2 | 19.4 | 87.4 | 19.7 | 87.5 | 12.5 | 85.8 | 22 | 88 | 0.0606 | 0.0121 | |
| FedAvg (70% mono)Training Setting=FedAvg (70% mono)2026.03 | 33.5 | 90 | 23.2 | 88.1 | 20.6 | 88 | 24 | 88.1 | 20.3 | 88 | 15.4 | 87.2 | 18.1 | 87.2 | 11.4 | 85.5 | 20.8 | 87.8 | 0.0657 | 0.0128 | |
| FedAvg (85% mono)Training Setting=FedAvg (85% mono)2026.03 | 33.4 | 90 | 22.9 | 88.1 | 19.7 | 87.9 | 24.2 | 88.1 | 19.3 | 87.8 | 15.7 | 87.2 | 17.3 | 87.2 | 11.2 | 85.4 | 20.5 | 87.7 | 0.0664 | 0.0128 | |
| FedAvg (100% mono)Training Setting=FedAvg (100% mono)2026.03 | 33 | 90 | 22.9 | 88.1 | 19.4 | 87.8 | 23.7 | 88 | 18.9 | 87.8 | 16.2 | 87.1 | 17.4 | 87.1 | 11 | 85.4 | 20.3 | 87.7 | 0.0647 | 0.0129 | |
| Local FT (DE)Training Setting=Local FT (DE)2026.03 | 32.2 | 89.8 | 23.7 | 88.1 | 21.2 | 88.3 | 23.3 | 88 | 18.9 | 87.7 | 18.1 | 87.1 | 16.5 | 87 | 10.5 | 85.1 | 20.6 | 87.6 | 0.0632 | 0.0134 | |
| Local FT (DA)Training Setting=Local FT (DA)2026.03 | 31.5 | 89.5 | 24.1 | 88.2 | 18.5 | 87.5 | 24.4 | 88.1 | 22.8 | 88.6 | 16.8 | 86.8 | 15.1 | 86.3 | 10.9 | 84.9 | 20.5 | 87.5 | 0.0647 | 0.0145 | |
| Base ModelTraining Setting=Base Model2026.03 | 30.7 | 89.3 | 21.5 | 87.7 | 17 | 87.3 | 20.7 | 87.1 | 16 | 86.9 | 7.4 | 86.1 | 12.6 | 85.6 | 8 | 84 | 16.7 | 86.7 | 0.077 | 0.0157 | |
| Local FT (CA)Training Setting=Local FT (CA)2026.03 | 29.6 | 89.3 | 13.1 | 86.6 | 16.8 | 87.1 | 25.3 | 88.4 | 14.6 | 86.5 | 14.5 | 86 | 10.4 | 84.9 | 6.5 | 83.4 | 16.3 | 86.5 | 0.0761 | 0.0186 | |
| Local FT (ES)Training Setting=Local FT (ES)2026.03 | 29.5 | 89.7 | 24.8 | 88.3 | 18.8 | 87.7 | 19.6 | 87.6 | 18.7 | 87.5 | 16.8 | 86.8 | 15.9 | 86.6 | 10.2 | 85 | 19.3 | 87.4 | 0.058 | 0.0147 | |
| Local FT (EU)Training Setting=Local FT (EU)2026.03 | 27.3 | 88.8 | 22.4 | 87.7 | 18.2 | 87.1 | 22.3 | 87.6 | 17.8 | 87.2 | 16.3 | 86.2 | 14.5 | 85.9 | 14.3 | 86.4 | 19.1 | 87.1 | 0.0452 | 0.0094 | |
| Local FT (HR)Training Setting=Local FT (HR)2026.03 | 26.3 | 88.7 | 22.9 | 87.9 | 19 | 87.7 | 20.7 | 87.4 | 18.1 | 87.4 | 2.8 | 86.6 | 21.1 | 88.1 | 9.9 | 84.4 | 17.6 | 87.3 | 0.0762 | 0.0131 | |
| Local FT (SR)Training Setting=Local FT (SR)2026.03 | 25.9 | 88.3 | 18.4 | 86.2 | 15.4 | 86.2 | 17.4 | 86 | 10.7 | 84.8 | 20.7 | 87.6 | 2.4 | 86.9 | 4.6 | 81.9 | 14.4 | 86 | 0.0803 | 0.0197 |