Language Modeling on WikiText-2 Top 5% most uncertain tokens (test)
5.12NLLBayesian-LoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Bayesian-LoRAS=22026.01 | 5.12 | 0.9 | 0.0126 | |
| Bayesian-LoRAS=12026.01 | 5.14 | 0.92 | 0.0131 | |
| LoRA (MAP)variant=MAP2026.01 | 5.16 | 0.97 | 0.016 | |
| DropoutS=42026.01 | 5.19 | 0.95 | 0.0151 | |
| LoRA + Tempscaling=Temperature Scaling2026.01 | 5.25 | 0.92 | 0.0149 |