Instruction-following on DROP
51.53DROP ScoreBi-LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| Bi-LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 51.53 | |
| Bi-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 51.53 | |
| Full FTCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 51.52 | |
| DeLoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 51.4 | |
| HiRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 51.17 | |
| LoRA-SAMCost=×2, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 50.94 | |
| S^2-SAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 50.8 | |
| WSAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 50.63 | |
| DoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 50.53 | |
| Flat-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 50.44 | |
| LoRA-LookSAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 50.34 | |
| PiSSABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 50.2 | |
| RWP_LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 50.16 | |
| RWP_fullCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 50.11 | |
| ROPCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 49.96 | |
| LoRA-oBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 49.92 | |
| LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.08 | 49.82 | |
| LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 49.82 | |
| LoRA-nBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 49.8 | |
| LoRA-ESAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.08 | 49.31 |