Multiple-choice Science QA on ARC-E (Smaller Dist. Shift 18)
76.88AccuracyBLoB
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BLoBBackbone=Llama2-7B, PEFT Method=LoRA, Number of samples (N)=02024.06 | 76.88 | 10.7 | 0.67 | |
| BLoBBackbone=Llama2-7B, PEFT Method=LoRA, Number of samples (N)=102024.06 | 76.37 | 5.48 | 0.6 | |
| MCDBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 76 | 15.32 | 0.88 | |
| BBBBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 75.83 | 13.41 | 0.79 | |
| BLoBBackbone=Llama2-7B, PEFT Method=LoRA, Number of samples (N)=52024.06 | 75.82 | 5.96 | 0.64 | |
| MAPBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 75.47 | 15.68 | 0.93 | |
| ENSBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 75.18 | 6.44 | 0.69 | |
| MLEBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 75.12 | 16.47 | 0.92 | |
| LAPBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 74.94 | 8.51 | 0.7 |