List your company
ResearchFormerly WizWand

Instruction-following Evaluation Suite (MMLU, DROP, HEval, BBH) (test)

79.67MMLUBi-LoRA
78.8979.092579.29579.4975Aug 27, 2025
Updated 6mo ago

Evaluation results

MethodLinks
Bi-LoRACost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.6756.4971.3458.9366.61
LoRA-LookSAMCost=×1.5, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.6356.3567.8858.4165.57
LoRA-ESAMCost=×1.5, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.5554.8365.0458.4364.46
Flat-LoRACost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.5154.971.5458.1366.02
LoRA-oBARCost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.3755.769.9258.5365.88
LoRA-nBARCost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.3455.9669.9258.6765.97
VanillaCost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.2851.5570.9357.4764.81
ROPCost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.2252.7471.3457.8465.28
LoRA-SAMCost=×2, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.1954.5470.5358.2565.63
RWP_LoRACost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0879.0751.6971.3457.4564.89
RWP_fullCost=×1, Backbone=Qwen 2.5-14B, Evaluation Protocol=Fine-tuning2025.0878.9254.7571.1357.7665.64