Question Answering on SQuAD (eval)
59.84EM (Clean)SDBN-p
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SDBN-pBackbone=LLaMA-3.2-1B, PEFT Method=LoRA, Training Samples=2002026.06 | 59.84 | 35.08 | 52.2 | |
| NEFTuneBackbone=LLaMA-3.2-1B, PEFT Method=LoRA, Training Samples=2002026.06 | 59.72 | 32.72 | 48.08 | |
| VanillaBackbone=LLaMA-3.2-1B, PEFT Method=LoRA, Training Samples=2002026.06 | 58.92 | 32.44 | 47.28 | |
| EDABackbone=LLaMA-3.2-1B, PEFT Method=LoRA, Training Samples=2002026.06 | 58.88 | 32.44 | 47.96 | |
| FreeLBBackbone=LLaMA-3.2-1B, PEFT Method=LoRA, Training Samples=2002026.06 | 57 | 31.64 | 44.04 | |
| SMARTBackbone=LLaMA-3.2-1B, PEFT Method=LoRA, Training Samples=2002026.06 | 52.64 | 28.44 | 40.52 |