Commonsense Reasoning on LLaMA3.2-1B (MC+PEFT, test)
62.4BoolQ AccuracyLoRA
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LoRACompression=PruneNet, PEFT=LoRA2026.03 | 62.4 | 57.8 | 32.3 | 54.6 | 39.4 | 22.1 | 16.8 | 40.8 | |
| DoRACompression=PruneNet, PEFT=DoRA2026.03 | 62.3 | 60.3 | 32.6 | 55.4 | 40.4 | 21.5 | 17.6 | 41.4 | |
| LLaMA3.2-1BCompression=—, PEFT=—2026.03 | 60 | 90 | 30 | 70 | 70 | 30 | 10 | 51.4 | |
| CRISPCompression=CRISP (ours), PEFT=CRISP (ours)2026.03 | 57.4 | 53.4 | 27.9 | 51.4 | 30.8 | 23.4 | 26.6 | 38.7 | |
| DoRACompression=DFJR, PEFT=DoRA2026.03 | 57.2 | 54.7 | 27.3 | 50.9 | 29.2 | 19.8 | 13.6 | 36.1 | |
| LoRACompression=DFJR, PEFT=LoRA2026.03 | 48.9 | 53.5 | 26.4 | 50.3 | 28.6 | 20.6 | 14.4 | 34.7 | |
| LoRACompression=Basis-Sharing, PEFT=LoRA2026.03 | 37.8 | 52.8 | 26.8 | 48.6 | 28.2 | 19.3 | 16.2 | 32.8 | |
| DoRACompression=Basis-Sharing, PEFT=DoRA2026.03 | 37.8 | 53.8 | 26.8 | 51 | 28.9 | 19.2 | 13.2 | 33 |