Instruction following on MT-Bench GPT-4 scored (test)
6.31ScoreVB-LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| VB-LoRAModel=Llama2-13B, # Parameters=1.1M2024.05 | 6.31 | |
| FoRAParams (M)=80.0, Backbone=LLaMA-2-7B, Fine-tuning dataset=Alpaca-52K2026.05 | 6.15 | |
| LoRA#Model=Llama2-13B, # Parameters=250.3M2024.05 | 6.13 | |
| DoRAParams (M)=160.5, Backbone=LLaMA-2-7B, Fine-tuning dataset=Alpaca-52K2026.05 | 6 | |
| VeRAModel=Llama2-13B, # Parameters=2.4M2024.05 | 5.93 | |
| rsLoRAParams (M)=159.9, Backbone=LLaMA-2-7B, Fine-tuning dataset=Alpaca-52K2026.05 | 5.82 | |
| LoRAModel=Llama2-13B, # Parameters=250.3M2024.05 | 5.77 | |
| VB-LoRAModel=Llama2-7B, # Parameters=0.8M2024.05 | 5.71 | |
| LoRAParams (M)=159.9, Backbone=LLaMA-2-7B, Fine-tuning dataset=Alpaca-52K2026.05 | 5.7 | |
| LoRA#Model=Llama2-7B, # Parameters=159.9M2024.05 | 5.63 | |
| w/o FTModel=Llama2-13B2024.05 | 5.38 | |
| LoRA†Model=Llama2-7B, # Parameters=159.9M2024.05 | 5.19 | |
| VeRAModel=Llama2-7B, # Parameters=1.6M2024.05 | 5.08 | |
| w/o FTModel=Llama2-7B2024.05 | 4.79 |