Language Modeling on WikiText-2 Top 5% most uncertain tokens (val)
5.13NLLBayesian-LoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Bayesian-LoRAS=22026.01 | 5.13 | 0.91 | 0.79 | |
| Bayesian-LoRAS=12026.01 | 5.14 | 0.95 | 0.8 | |
| LoRA (MAP)variant=MAP2026.01 | 5.16 | 0.97 | 0.82 | |
| DropoutS=42026.01 | 5.21 | 0.94 | 0.79 | |
| LoRA + Tempscaling=Temperature Scaling2026.01 | 5.22 | 0.92 | 0.81 |