Instruction-following on HEval
46.12PASS@1Bi-LoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Bi-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 46.12 | — | |
| LoRA-nBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 45.23 | — | |
| LoRA-SAMCost=×2, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 44.36 | — | |
| RWP_fullCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 44.31 | — | |
| Flat-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 44.31 | — | |
| LoRA-oBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 43.49 | — | |
| LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 43.15 | — | |
| RWP_LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 42.68 | — | |
| LoRA-ESAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 42.48 | — | |
| LoRA-LookSAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 42.48 | — | |
| ROPCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 42.27 | — | |
| Full FTCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 41.45 | — | |
| Bi-LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 46.12 | |
| DeLoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 45.53 | |
| DoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 44.1 | |
| HiRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 45.12 | |
| LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 43.15 | |
| PiSSABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 43.86 | |
| S^2-SAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 43.09 | |
| WSAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | — | 42.88 |