List your company

Instruction Fine-tuning on Alpaca-52K (train)

65.88Average ScoreFull-finetuning
64.0664.532565.00565.4775Feb 18, 2025

Evaluation results

MethodLinks
Full-finetuningBackbone=LLaMA2-7B, LLMs branch=16-16-16, low-rank branch=16-16-162025.0265.882.458.56
QLORABackbone=LLaMA2-7B, LLMs branch=4-16-16, low-rank branch=16-16-162025.0265.693.210.73
GSQ-TuningBackbone=LLaMA2-7B, LLMs branch=4-6-6, low-rank branch=6-6-62025.0265.393.45.97
LLaMA2-7BLLMs branch=16-16-None, low-rank branch=w/o2025.0264.13013.2