List your company
ResearchFormerly WizWand

Question Answering on OpenBookQA (Accuracy Improvement)

2.01Accuracy ImprovementAUTOMIXER-350M
-0.1220.43150.9851.5385Jun 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
AUTOMIXER-350MNumber of Parameters=350M2025.062.01
AUTOMIXER-350MNumber of Parameters=1.5B2025.061.33
AUTOMIXER-350MNumber of Parameters=3B2025.061.23
N-GRAM SAMPLINGNumber of Parameters=350M2025.061.16
N-GRAM SAMPLINGNumber of Parameters=3B2025.060.95
PPL SAMPLINGNumber of Parameters=1.5B2025.060.75
N-GRAM SAMPLINGNumber of Parameters=1.5B2025.060.54
PPL SAMPLINGNumber of Parameters=3B2025.060.5
PPL SAMPLINGNumber of Parameters=350M2025.060.4
AUTOMIXER-75MNumber of Parameters=1.5B2025.060.01
AUTOMIXER-75MNumber of Parameters=350M2025.06-0.03
AUTOMIXER-75MNumber of Parameters=3B2025.06-0.04