Commonsense Reasoning on Commonsense170k (test)
76.4BoolQ AccuracyFull FT
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Full FTBase Model=LLaMA-3-8B, r/N=N/A, #Params=8 B (100%)2026.06 | 76.4 | 89.7 | 82.5 | 84.3 | 92.9 | 89.2 | 95.5 | 89.6 | 87.5 | |
| Full FTBase Model=Llama-3-8B, Params (%)=1002025.09 | 75.4 | 88 | 81.8 | 96.5 | 89.3 | 93.1 | 83 | 86 | 86.64 | |
| DoRABase Model=LLaMA-3-8B, r/N=r=32, #Params=63 M (0.79%)2026.06 | 74.6 | 89.3 | 79.9 | 80.4 | 90.5 | 85.8 | 95.5 | 85.6 | 85.2 | |
| Full FTBase Model=Llama-2-7B, Params (%)=1002025.09 | 73.8 | 84.2 | 81 | 94.7 | 85.2 | 88.9 | 75.6 | 84.8 | 83.53 | |
| Full FTBase Model=LLaMA-2-7B, r/N=N/A, #Params=6.7 B (100%)2026.06 | 73.3 | 85.7 | 81 | 77.4 | 88.6 | 85.2 | 90.2 | 86.9 | 83.5 | |
| CORABase Model=LLaMA-2-7B, r/N=r=16, #Params=6.6 M (0.10%)2026.06 | 73.2 | 84.6 | 81.8 | 73.5 | 87.1 | 83.6 | 88.6 | 84.9 | 82.16 | |
| HiRABase Model=Llama-3-8B, Params (%)=0.1695, r=322025.09 | 73.09 | 88.85 | 81.06 | 80.38 | 92.68 | 86.2 | 94.37 | 85.87 | 85.31 | |
| CORABase Model=LLaMA-3-8B, r/N=r=16, #Params=10.3 M (0.13%)2026.06 | 72.9 | 89.9 | 82.6 | 83.5 | 92.6 | 87.2 | 96.3 | 88.2 | 86.65 | |
| CORABase Model=LLaMA-3-8B, r/N=r=8, #Params=4.8 M (0.06%)2026.06 | 72.5 | 89 | 81.1 | 82.1 | 93.1 | 87 | 95.6 | 87.6 | 86 | |
| CORABase Model=LLaMA-2-7B, r/N=r=32, #Params=13.6 M (0.20%)2026.06 | 72.2 | 85.5 | 81.5 | 72.8 | 86.4 | 84.2 | 87.2 | 86.7 | 82.06 | |
| CORABase Model=LLaMA-3-8B, r/N=r=64, #Params=43.3 M (0.54%)2026.06 | 72.2 | 88.2 | 82.7 | 83.1 | 92.2 | 87 | 96.1 | 88.2 | 86.21 | |
| CORABase Model=LLaMA-3-8B, r/N=r=32, #Params=21.3 M (0.27%)2026.06 | 72 | 89.2 | 83.2 | 83.2 | 93.5 | 88.2 | 96.2 | 88.5 | 86.75 | |
| LoRABase Model=Llama-3-8B, Params (%)=0.16952025.09 | 71.99 | 85.91 | 79.58 | 76.19 | 88.55 | 82.6 | 92.54 | 85.63 | 82.88 | |
| DoRABase Model=LLaMA-2-7B, r/N=r=32, #Params=57 M (0.85%)2026.06 | 71.8 | 83.7 | 76 | 68.2 | 83.7 | 82.4 | 89.1 | 82.6 | 79.7 | |
| CORABase Model=LLaMA-2-7B, r/N=r=64, #Params=27.6 M (0.41%)2026.06 | 70.8 | 83.9 | 80.2 | 71.1 | 85.8 | 82 | 81.3 | 84.5 | 79.95 | |
| LoRABase Model=LLaMA-3-8B, r/N=r=32, #Params=63 M (0.79%)2026.06 | 70.8 | 85.2 | 79.9 | 71.2 | 84.2 | 79 | 91.7 | 84.3 | 80.8 | |
| TeRABase Model=Llama-3-8B, Params (%)=0.00332025.09 | 70.7 | 88.08 | 81.58 | 80.89 | 92 | 88 | 94.92 | 86.27 | 85.31 | |
| QuanTABase Model=Llama-3-8B, Params (%)=0.03432025.09 | 70.03 | 88.41 | 81.67 | 81.05 | 92.21 | 85.6 | 94.68 | 88.47 | 85.27 | |
| LoRABase Model=LLaMA-2-7B, r/N=r=32, #Params=56 M (0.84%)2026.06 | 69.8 | 79.9 | 79.5 | 64.7 | 79.8 | 81 | 83.6 | 82.6 | 77.6 | |
| CORABase Model=LLaMA-2-7B, r/N=r=8, #Params=3.1 M (0.05%)2026.06 | 69.7 | 84.2 | 81.3 | 73.1 | 87.1 | 85.2 | 88.5 | 85.2 | 81.79 | |
| HiRABase Model=Llama-2-7B, Params (%)=0.2484, r=322025.09 | 69.39 | 83.24 | 78.86 | 71.33 | 86.57 | 81.4 | 87.23 | 81.69 | 79.97 | |
| MoRABase Model=Llama-3-8B, Params (%)=0.1692, r=322025.09 | 69.05 | 88.25 | 80.14 | 80.89 | 92.72 | 84.2 | 94.09 | 85 | 84.29 | |
| MiLoRABase Model=LLaMA-3-8B, r/N=r=32, #Params=63 M (0.79%)2026.06 | 68.8 | 86.7 | 77.2 | 75.5 | 86.8 | 81.8 | 92.9 | 85.6 | 81.9 | |
| HiRABase Model=Llama-3-8B, Params (%)=0.0053, r=12025.09 | 68.04 | 85.75 | 75.54 | 76.96 | 90.32 | 77 | 89.04 | 77.43 | 80.01 | |
| VeRABase Model=Llama-3-8B, Params (%)=0.00222025.09 | 67.95 | 85.64 | 76.51 | 77.22 | 91.29 | 81 | 91.96 | 82.24 | 81.73 | |
| LoRABase Model=Llama-2-7B, Params (%)=0.24842025.09 | 67.65 | 79.22 | 78.2 | 69.2 | 83.88 | 78.6 | 81.05 | 80.98 | 77.35 | |
| PiSSABase Model=LLaMA-2-7B, r/N=r=32, #Params=56 M (0.84%)2026.06 | 67.6 | 78.1 | 78.4 | 60.2 | 75.8 | 75.6 | 76.6 | 78 | 73.8 | |
| MiLoRABase Model=LLaMA-2-7B, r/N=r=32, #Params=56 M (0.84%)2026.06 | 67.6 | 83.8 | 80.1 | 68.8 | 82.8 | 80.6 | 88.2 | 82 | 79.2 | |
| LoRETTABase Model=Llama-2-7B, Params (%)=0.00522025.09 | 67.52 | 79.33 | 76.31 | 65.7 | 84.34 | 76 | 86.32 | 80.98 | 77.06 | |
| PiSSABase Model=LLaMA-3-8B, r/N=r=32, #Params=63 M (0.79%)2026.06 | 67.1 | 81.1 | 77.2 | 63.2 | 77.7 | 74.6 | 83.6 | 78.9 | 75.4 | |
| QuanTABase Model=Llama-2-7B, Params (%)=0.04082025.09 | 66.88 | 81.28 | 78.45 | 70.82 | 85.4 | 79.4 | 75.86 | 82.16 | 77.53 | |
| TeRABase Model=Llama-2-7B, Params (%)=0.00392025.09 | 65.78 | 81.23 | 78.92 | 69.45 | 84.05 | 81 | 85.94 | 82.64 | 78.63 | |
| HiRABase Model=Llama-2-7B, Params (%)=0.0078, r=12025.09 | 65.35 | 77.97 | 72.42 | 62.03 | 81.48 | 64.8 | 79.9 | 70.01 | 71.74 | |
| MoRABase Model=Llama-2-7B, Params (%)=0.2484, r=322025.09 | 65.17 | 81.12 | 77.74 | 67.75 | 84.47 | 75.8 | 84.12 | 79.64 | 76.97 | |
| LoRETTABase Model=Llama-3-8B, Params (%)=0.00452025.09 | 65.17 | 89.01 | 79.53 | 79.86 | 91.54 | 84.4 | 94.4 | 84.69 | 83.58 | |
| VeRABase Model=Llama-2-7B, Params (%)=0.00412025.09 | 64.59 | 78.84 | 76.56 | 65.44 | 83.63 | 73.2 | 82.71 | 77.9 | 75.36 | |
| P-TuningBase Model=Llama-3-8B, Params (%)=0.62402025.09 | 59.97 | 11.64 | 8.19 | 7.42 | 8.63 | 9.6 | 1.77 | 37.65 | 18.11 | |
| P-TuningBase Model=Llama-2-7B, Params (%)=0.74282025.09 | 58.75 | 36.02 | 0.2 | 0.17 | 1.98 | 0.8 | 0.01 | 0 | 12.24 | |
| Prompt TuningBase Model=Llama-3-8B, Params (%)=0.00102025.09 | 56.85 | 45.05 | 36.13 | 31.57 | 32.74 | 29.2 | 14.01 | 50.12 | 36.96 | |
| Prompt TuningBase Model=Llama-2-7B, Params (%)=0.00122025.09 | 55.93 | 12.35 | 30.5 | 6.06 | 8.63 | 9.4 | 6.91 | 40.57 | 21.29 |