Supervised Fine-tuning on SFT (train)
2.614SFT Train LossPeri-LN
Evaluation results
| Method | Links | |
|---|---|---|
| Peri-LNBackbone=Llama-3B, Fine-tuning=LoRA-based SFT2025.12 | 2.614 | |
| RMSNormBackbone=Llama-3B, Fine-tuning=LoRA-based SFT2025.12 | 2.646 | |
| LNSBackbone=Llama-3B, Fine-tuning=LoRA-based SFT2025.12 | 2.652 | |
| BHyTBackbone=Llama-3B, Fine-tuning=LoRA-based SFT2025.12 | 2.693 | |
| DyTBackbone=Llama-3B, Fine-tuning=LoRA-based SFT2025.12 | 3.361 |