Multiple-choice science question answering on ARC-C Smaller Dist. Shift 18
69.93AccuracyBLoB
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BLoBBackbone=Llama2-7B, PEFT Method=LoRA, Number of samples (N)=02024.06 | 69.93 | 14 | 0.89 | |
| MAPBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 69.59 | 19.31 | 1.1 | |
| LAPBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 69.14 | 5.84 | 0.81 | |
| MCDBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 69.03 | 19.54 | 1.08 | |
| BLoBBackbone=Llama2-7B, PEFT Method=LoRA, Number of samples (N)=52024.06 | 68.36 | 9.76 | 0.85 | |
| BLoBBackbone=Llama2-7B, PEFT Method=LoRA, Number of samples (N)=102024.06 | 67.71 | 9.55 | 0.83 | |
| ENSBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 67.34 | 7.59 | 0.86 | |
| BBBBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 67.25 | 19.9 | 1.06 | |
| MLEBackbone=Llama2-7B, PEFT Method=LoRA2024.06 | 66.2 | 22.2 | 1.16 |