Instruction Following on MMLU
64.31MMLU AccuracyFull FT
Evaluation Results
| Method | Links | |
|---|---|---|
| Full FTCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 64.31 | |
| S^2-SAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.73 | |
| Bi-LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.67 | |
| Flat-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.67 | |
| Bi-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.67 | |
| ROPCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.63 | |
| HiRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.62 | |
| LoRA-oBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.62 | |
| PiSSABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.59 | |
| DoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.58 | |
| RWP_LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.5 | |
| DeLoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.49 | |
| LoRA-SAMCost=×2, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.46 | |
| LoRA-nBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.45 | |
| LoRA-LookSAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.45 | |
| WSAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.42 | |
| RWP_fullCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.4 | |
| LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 63.38 | |
| LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 63.38 | |
| LoRA-ESAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 61.79 |