Korean LLM Evaluation on LogicKor ko
7.76LogicKor ScoreLlama3.1-ELO
Evaluation results
| Method | Links | |
|---|---|---|
| Llama3.1-ELOTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=9 GB (2.5 B), CP / ELO pretraining Time=1.5 h, Layer alignment Data size (Tokens)=1 GB (0.3 B), Layer alignment Time=2.0 h, Total training time=3.5 h2026.01 | 7.76 | |
| Llama3.1-FFTTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=10 GB (2.8 B), CP / ELO pretraining Time=19.8 h, Total training time=19.8 h2026.01 | 7.31 | |
| Qwen2-ELOTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=9 GB (2.8 B), CP / ELO pretraining Time=1.8 h, Layer alignment Data size (Tokens)=1 GB (0.3 B), Layer alignment Time=2.1 h, Total training time=3.9 h2026.01 | 7.22 | |
| Qwen2-FFTTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=10 GB (3.1 B), CP / ELO pretraining Time=20.5 h, Total training time=20.5 h2026.01 | 6.95 | |
| Qwen2-7B-InstructTarget Language Adaptation Setting=Korean2026.01 | 6.9 | |
| Mistral-ELOTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=9 GB (4.2 B), CP / ELO pretraining Time=1.7 h, Layer alignment Data size (Tokens)=1 GB (0.6 B), Layer alignment Time=3.1 h, Total training time=4.8 h2026.01 | 6.59 | |
| Mistral-FFTTarget Language Adaptation Setting=Korean, CP / ELO pretraining Data size (Tokens)=10 GB (4.7 B), CP / ELO pretraining Time=31.0 h, Total training time=31.0 h2026.01 | 6.5 | |
| Llama3.1-8B-InstructTarget Language Adaptation Setting=Korean2026.01 | 6.03 | |
| Mistral-7B-Instruct-v0.3Target Language Adaptation Setting=Korean2026.01 | 4.49 |