List your company
ResearchFormerly WizWand

Instruction-following on DROP

51.53DROP ScoreBi-LoRA
49.221249.820650.4251.0194Aug 27, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Bi-LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0851.53
Bi-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0851.53
Full FTCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0851.52
DeLoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0851.4
HiRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0851.17
LoRA-SAMCost=×2, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0850.94
S^2-SAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0850.8
WSAMBackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0850.63
DoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0850.53
Flat-LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0850.44
LoRA-LookSAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0850.34
PiSSABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0850.2
RWP_LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0850.16
RWP_fullCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0850.11
ROPCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0849.96
LoRA-oBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0849.92
LoRABackbone=Llama 3.1-8B, Evaluation Protocol=fine-tuning2025.0849.82
LoRACost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0849.82
LoRA-nBARCost=×1, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0849.8
LoRA-ESAMCost=×1.x, Backbone=Llama 3.1-8B, Evaluation Protocol=Fine-tuning2025.0849.31