List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on OBQA (ACC, ECE)

0.884AccuracyUQ4CT
0.8596640.8659820.87230.878618Oct 9, 2024
Updated 5mo ago

Evaluation results

MethodLinks
UQ4CTBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA, Number of forward passes=12024.100.8843.341
MixLoRABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.100.8836.58
LoRABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.100.88017.3
BLoB(Mean)Backbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.100.87616.83
MC DropBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.100.87117.24
BLoB(N=10)Backbone=Llama3.1-8B, Fine-tuned Dataset=OBQA, Number of forward passes=102024.100.8713.841
EnsembleBackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.100.8658.63
LABackbone=Llama3.1-8B, Fine-tuned Dataset=OBQA2024.100.860611.975