Language Modeling on WikiText-2 All tokens (test)
1.66NLLBayesian-LoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Bayesian-LoRAS=22026.01 | 1.66 | 0.48 | 1.41 | |
| DropoutS=42026.01 | 1.7 | 0.5 | 1.59 | |
| Bayesian-LoRAS=12026.01 | 1.71 | 0.51 | 1.51 | |
| LoRA (MAP)variant=MAP2026.01 | 1.75 | 0.52 | 1.48 | |
| LoRA + Tempscaling=Temperature Scaling2026.01 | 1.77 | 0.5 | 1.54 |