Multiple Choice Question Answering on Health
61.11AccuracyUQ4CT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| UQ4CTBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA, Number of forward passes=12024.10 | 61.11 | 13.24 | |
| MixLoRABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 60.91 | 18.02 | |
| EnsembleBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 60.6 | 16.12 | |
| LABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 59.7 | 15.72 | |
| LoRABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 58.8 | 24.01 | |
| BLoB(N=10)Backbone=Llama3.1-8B, Fine-tuned Dataset=OBQA, Number of forward passes=102024.10 | 58.55 | 14.53 | |
| MC DropBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 58.31 | 21.63 | |
| BLoB(Mean)Backbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.10 | 57.03 | 16.93 |