Commonsense Reasoning on OpenBookQA (ACC, ECE, NLL)
81.6ACCBayesian-LoRA (S=4)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Bayesian-LoRA (S=4)S (Samples)=4, Evaluation Protocol=End-to-End, rind=9, cind=92026.01 | 81.6 | 5.7 | 0.49 | |
| BLoB (N=10)N (Ensemble Size)=10, rind=9, cind=92026.01 | 81.52 | 3.77 | 0.5 | |
| Ckpt Ensrind=9, cind=92026.01 | 78.2 | 4.7 | 0.65 | |
| LA (post-hoc)Evaluation Protocol=post-hoc, rind=9, cind=92026.01 | 78.1 | 3.5 | 0.62 | |
| MAPrind=9, cind=92026.01 | 77.7 | 9.8 | 0.71 | |
| Dropoutrind=9, cind=92026.01 | 77.7 | 8.8 | 0.71 | |
| Temprind=9, cind=92026.01 | 77.7 | 7.2 | 0.67 | |
| LLLA (post-hoc)Evaluation Protocol=post-hoc, rind=9, cind=92026.01 | 77.6 | 5.4 | 0.66 | |
| BBBrind=9, cind=92026.01 | 77.02 | 11.38 | 0.66 |