Commonsense Reasoning on BoolQ, PIQA, SIQA, HellaSwag, WinoGrande, OBQA (test)
88.5BoolQ AccuracyFull FT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Full FT# Params(%)=1002025.12 | 88.5 | 83.79 | 81.16 | 92.5 | 82.95 | 78.6 | 84.58 | |
| FRoDs=0.02, # Params(%)=0.182025.12 | 87.74 | 83.62 | 81.17 | 93.28 | 80.98 | 74.4 | 83.53 | |
| RandLoRA# Params(%)=0.842025.12 | 87.65 | 82.7 | 88.05 | 92.91 | 75.77 | 34.2 | 76.88 | |
| VeRA# Params(%)=0.022025.12 | 77.68 | 69.58 | 84.73 | 87.99 | 50 | 30.2 | 66.7 | |
| GOAT# Params(%)=0.962025.12 | 73.6 | 83.95 | 80.55 | 80.5 | 85 | 87 | 82.73 | |
| ChatGPT2025.12 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 74.8 | 77.01 | |
| DoRA# Params(%)=0.842025.12 | 71.8 | 83.1 | 79.9 | 89.1 | 83 | 81.2 | 80.45 | |
| LoRA# Params(%)=0.842025.12 | 69.8 | 79.9 | 70.5 | 83.6 | 82.6 | 81 | 77.61 | |
| PiSSA# Params(%)=0.842025.12 | 67.6 | 78 | 71.8 | 78 | 75.8 | 75.6 | 73.78 | |
| MiLoRA# Params(%)=0.842025.12 | 67.6 | 83.3 | 73.4 | 88.2 | 83 | 80.8 | 79.24 |