Code Generation on CodeAlpaca (test)
4.12Perplexity (PPL)Full FT Sequential
Evaluation results
| Method | Links | |
|---|---|---|
| Full FT SequentialTraining Protocol=Sequential (A then B), Stage=after Task A+B2026.02 | 4.12 | |
| LoRA SequentialTraining Protocol=Sequential (A then B), Stage=after Task A+B, Rank=82026.02 | 4.48 | |
| LoRA A + LoRA BTraining Protocol=Separate adapters, Stage=after Task A+B, Rank=82026.02 | 4.55 | |
| NIWFStage=after Task A+B2026.02 | 4.62 | |
| Base Mistral-7BTraining Protocol=None (No training), Stage=after Task A+B2026.02 | 12.41 |