Multiple Choice Question Answering on Law
45.4AccuracyUQ4CT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| UQ4CTBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA, Number of forward passes=12024.10 | 45.4 | 18.14 | |
| MixLoRABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 45.01 | 21.64 | |
| MC DropBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 45 | 29.1 | |
| EnsembleBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 45 | 19.92 | |
| LABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 44.91 | 19 | |
| LoRABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 44.9 | 29.31 | |
| BLoB(N=10)Backbone=Llama3.1-8B, Fine-tuned Dataset=OBQA, Number of forward passes=102024.10 | 43.84 | 19.73 | |
| BLoB(Mean)Backbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 39.97 | 22.61 |