Instruction Following on MT-Bench ja
5.68MT-Bench (ja) ScoreMistral-FFT
Evaluation results
| Method | Links | |
|---|---|---|
| Mistral-FFTTarget Language Adaptation Setting=Japanese, CP / ELO pretraining Data size (Tokens)=10 GB (4.1 B), CP / ELO pretraining Time=29.7 h, Total training time=29.7 h2026.01 | 5.68 | |
| Mistral-ELOTarget Language Adaptation Setting=Japanese, CP / ELO pretraining Data size (Tokens)=9 GB (3.7 B), CP / ELO pretraining Time=1.7 h, Layer alignment Data size (Tokens)=1 GB (0.4 B), Layer alignment Time=3.0 h, Total training time=4.7 h2026.01 | 5.68 | |
| Llama3.1-ELOTarget Language Adaptation Setting=Japanese, CP / ELO pretraining Data size (Tokens)=9 GB (2.4 B), CP / ELO pretraining Time=1.4 h, Layer alignment Data size (Tokens)=1 GB (0.3 B), Layer alignment Time=2.0 h, Total training time=3.4 h2026.01 | 5.58 | |
| Llama3.1-FFTTarget Language Adaptation Setting=Japanese, CP / ELO pretraining Data size (Tokens)=10 GB (2.7 B), CP / ELO pretraining Time=19.4 h, Total training time=19.4 h2026.01 | 5.38 | |
| Llama3.1-8B-InstructTarget Language Adaptation Setting=Japanese2026.01 | 4.85 | |
| Mistral-7B-Instruct-v0.3Target Language Adaptation Setting=Japanese2026.01 | 4.36 |