Commonsense Reasoning on Commonsense Reasoning 8 datasets
73.6BoolQ AccuracyKaSA
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| KaSA# Params(%)=0.842025.02 | 73.6 | 84.4 | 80.2 | 91.5 | 84.5 | 84.7 | 72.1 | 81.2 | 81.53 | |
| GOAT# Params(%)=0.962025.02 | 73.6 | 83.95 | 80.5 | 87.12 | 85 | 87.79 | 76.88 | 87 | 82.73 | |
| MoLoRA# Params(%)=0.962025.02 | 73.15 | 83.68 | 80.09 | 74.57 | 85.95 | 87.33 | 72.53 | 86.2 | 80.43 | |
| ChatGPT# Params(%)=/2025.02 | 73.1 | 85.4 | 68.5 | 78.5 | 66.1 | 89.8 | 79.9 | 74.8 | 77.01 | |
| HydraLoRA# Params(%)=0.842025.02 | 72.78 | 84.06 | 79.68 | 80.34 | 86.66 | 87.12 | 72.35 | 86 | 81.12 | |
| DoRA# Params(%)=0.842025.02 | 71.8 | 83.1 | 79.9 | 89.1 | 83 | 84.5 | 71 | 81.2 | 80.45 | |
| NEAT# Params(%)=0.842025.02 | 71.7 | 83.9 | 80.2 | 88.9 | 84.3 | 86.3 | 71.4 | 83 | 81.21 | |
| LoRA-Dash# Params(%)=0.842025.02 | 71 | 75.7 | 79.3 | 91.1 | 78.6 | 84.2 | 69.8 | 78.8 | 78.56 | |
| LoRA# Params(%)=0.842025.02 | 69.8 | 79.9 | 79.5 | 83.6 | 82.6 | 79.8 | 64.7 | 81 | 77.61 | |
| PiSSA# Params(%)=0.842025.02 | 67.6 | 78.1 | 78.4 | 76.6 | 78 | 75.8 | 60.2 | 75.6 | 73.78 | |
| MiLoRA# Params(%)=0.842025.02 | 67.6 | 83.8 | 80.1 | 88.2 | 82 | 82.8 | 68.8 | 80.6 | 79.24 |