Korean Language Understanding on KoBEST ko
72.37KoBEST AccuracyQwen2-FFT
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2-FFTTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=10 GB (3.1 B), CP / ELO pretraining Time=20.5 h, Total training time=20.5 h2026.01 | 72.37 | |
| Qwen2-ELOTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=9 GB (2.8 B), CP / ELO pretraining Time=1.8 h, Layer alignment Data size (Tokens)=1 GB (0.3 B), Layer alignment Time=2.1 h, Total training time=3.9 h2026.01 | 71.57 | |
| Llama3.1-FFTTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=10 GB (2.8 B), CP / ELO pretraining Time=19.8 h, Total training time=19.8 h2026.01 | 66.08 | |
| Mistral-FFTTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=10 GB (4.7 B), CP / ELO pretraining Time=31.0 h, Total training time=31.0 h2026.01 | 61.68 | |
| Llama3.1-ELOTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=9 GB (2.5 B), CP / ELO pretraining Time=1.5 h, Layer alignment Data size (Tokens)=1 GB (0.3 B), Layer alignment Time=2.0 h, Total training time=3.5 h2026.01 | 60.81 | |
| Mistral-ELOTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=9 GB (4.2 B), CP / ELO pretraining Time=1.7 h, Layer alignment Data size (Tokens)=1 GB (0.6 B), Layer alignment Time=3.1 h, Total training time=4.8 h2026.01 | 60.56 | |
| Qwen2-7B-InstructTarget Language Adaptation Setting=Korean2026.01 | 60.17 | |
| Llama3.1-8B-InstructTarget Language Adaptation Setting=Korean2026.01 | 56.02 | |
| Mistral-7B-Instruct-v0.3Target Language Adaptation Setting=Korean2026.01 | 49.01 |