Commonsense Reasoning on ARC-e, ARC-c, BoolQ, OBQA, PIQA (test)
77.7ARC-eMixLoRA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MixLoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=ST2024.04 | 77.7 | 58.1 | 72.7 | 81.6 | 83.2 | 74.7 | |
| MixDoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=ST2024.04 | 77.5 | 58.2 | 72.6 | 80.9 | 82.2 | 74.3 | |
| MixDoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=MT2024.04 | 76.9 | 63.4 | 71.8 | 82.2 | 80.4 | 74.9 | |
| MixLoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=MT2024.04 | 76.6 | 64.2 | 71.2 | 81.6 | 82.7 | 75.3 | |
| DoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=ST2024.04 | 76.5 | 59.8 | 71.7 | 80.6 | 82.7 | 74.3 | |
| LoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=ST2024.04 | 73.8 | 50.9 | 62.2 | 80.4 | 82.1 | 69.9 | |
| DoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=MT2024.04 | 64.5 | 54.1 | 65.4 | 75.8 | 71.9 | 66.3 | |
| LoRABase Model=LLaMA2 7B, #Params (%)=2.9%, ST/MT=MT2024.04 | 61.3 | 55.7 | 66.7 | 71.6 | 72.4 | 65.5 |