Commonsense Reasoning on WG-M
76.45AccuracyMCD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MCDBackbone=Llama2-7B, Method=LoRA, Steps=5,0002024.06 | 76.45 | 19.55 | 1.02 | |
| MAPBackbone=Llama2-7B, Method=LoRA, Steps=5,0002024.06 | 75.61 | 23.07 | 1.62 | |
| LAPBackbone=Llama2-7B, Method=LoRA, Steps=5,0002024.06 | 75.55 | 7.4 | 0.57 | |
| ENSBackbone=Llama2-7B, Method=LoRA, Steps=5,0002024.06 | 75.32 | 20.86 | 1.25 | |
| BLoBBackbone=Llama2-7B, Method=LoRA, Steps=5,000, N=02024.06 | 74.55 | 11.23 | 0.6 | |
| MLEBackbone=Llama2-7B, Method=LoRA, Steps=5,0002024.06 | 74.53 | 20.62 | 0.95 | |
| Bayesian-LoRA (S=4)S (Samples)=4, Evaluation Protocol=End-to-End, rind=9, cind=92026.01 | 74.3 | 3 | 0.62 | |
| Ckpt Ensrind=9, cind=92026.01 | 73.8 | 22.8 | 1.89 | |
| MAPrind=9, cind=92026.01 | 73.7 | 24.9 | 2.43 | |
| Temprind=9, cind=92026.01 | 73.7 | 6.3 | 0.58 | |
| LLLA (post-hoc)Evaluation Protocol=post-hoc, rind=9, cind=92026.01 | 73.7 | 3.8 | 0.56 | |
| LA (post-hoc)Evaluation Protocol=post-hoc, rind=9, cind=92026.01 | 73.7 | 4.8 | 0.55 | |
| BLoBBackbone=Llama2-7B, Method=LoRA, Steps=5,000, N=102024.06 | 73.69 | 3.01 | 0.54 | |
| BLoB (N=10)N (Ensemble Size)=10, rind=9, cind=92026.01 | 73.69 | 3.01 | 0.54 | |
| BBBBackbone=Llama2-7B, Method=LoRA, Steps=5,0002024.06 | 73.63 | 15.76 | 0.84 | |
| BBBrind=9, cind=92026.01 | 73.63 | 15.76 | 0.84 | |
| Dropoutrind=9, cind=92026.01 | 73.5 | 23.5 | 2.12 | |
| BLoBBackbone=Llama2-7B, Method=LoRA, Steps=5,000, N=52024.06 | 72.89 | 4.51 | 0.56 |