Instruction Following on Instruction Following SFT 1.0 (eval)
59.4SFT ScoreRandom Sampling KD (Ours 12)
Evaluation results
| Method | Links | |
|---|---|---|
| Random Sampling KD (Ours 12)Unique Tokens=122025.03 | 59.4 | |
| Random Sampling KD (Ours 12+)Unique Tokens=12, Adaptive Weighting=true2025.03 | 59.1 | |
| FullKD2025.03 | 58.4 | |
| Top-K 50K=502025.03 | 58.3 | |
| Top-K 12K=122025.03 | 57.7 | |
| CE2025.03 | 54.5 |