Reasoning on WinoGrande Small (WG-S)
70.43AccuracyBayesLoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BayesLoRAk=0, Params (M)=2.40–3.872025.06 | 70.43 | 29.26 | 2.78 | |
| BayesLoRAr=8, k=0, Params (M)=4.482025.06 | 69.64 | 29.82 | 2.69 | |
| ENSParams (M)=44.802025.06 | 69.57 | 28.52 | 2.71 | |
| MCDParams (M)=4.482025.06 | 69.46 | 27.98 | 2.79 | |
| BayesLoRAk=10, Params (M)=2.40–3.872025.06 | 69.4 | 20.62 | 1.45 | |
| LoRAParams (M)=4.482025.06 | 68.99 | 29.83 | 3.17 | |
| BayesLoRAr=8, k=10, Params (M)=4.482025.06 | 68.53 | 21.09 | 1.37 | |
| BBBParams (M)=9.982025.06 | 56.54 | 21.81 | 1.4 |