Question Answering on SQuAD v2 (test)
60.8EMScaled PSI-LoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Scaled PSI-LoRAη=0.52026.02 | 60.8 | 62.41 | 0.7546 | |
| Fullη=1e-42026.02 | 56.57 | 57.55 | 0.7145 | |
| LoRAη=5e-42026.02 | 56.52 | 57.56 | 0.7951 |
Loading the SOTA2 catalog…
| Method | Links | |||
|---|---|---|---|---|
| Scaled PSI-LoRAη=0.52026.02 | 60.8 | 62.41 | 0.7546 | |
| Fullη=1e-42026.02 | 56.57 | 57.55 | 0.7145 | |
| LoRAη=5e-42026.02 | 56.52 | 57.56 | 0.7951 |