Commonsense Reasoning on PIQA (Accuracy Delta)
0.8Accuracy DeltaLoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRALR=10−2, Params=92K2026.04 | 0.8 | |
| GAIN-FFNLR=10−3, Params=230K2026.04 | 0.2 | |
| GAINLR=3×10−4, Params=46K2026.04 | 0.1 | |
| GAINLR=10−3, Params=46K2026.04 | 0.1 | |
| GAIN-FFNLR=3×10−3, Params=230K2026.04 | 0.1 | |
| LoRALR=10−4, Params=92K2026.04 | 0.1 | |
| LoRALR=10−3, Params=92K2026.04 | 0.1 | |
| GAINLR=3×10−3, Params=46K2026.04 | 0 | |
| LoRALR=3×10−4, Params=92K2026.04 | 0 |