Language Modeling on WikiText-2 All tokens (val)
1.7NLLBayesian-LoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Bayesian-LoRAS=22026.01 | 1.7 | 0.48 | 1.36 | |
| Bayesian-LoRAS=12026.01 | 1.73 | 0.51 | 1.46 | |
| LoRA (MAP)variant=MAP2026.01 | 1.76 | 0.52 | 1.68 | |
| DropoutS=42026.01 | 1.77 | 0.5 | 1.54 | |
| LoRA + Tempscaling=Temperature Scaling2026.01 | 1.78 | 0.51 | 1.62 |