List your company
ResearchFormerly WizWand

Question Answering on MMMLU

36.14AccuracyOLTQA
24.824827.762430.733.6376May 11, 2023
Updated 8mo ago

Evaluation results

MethodLinks
OLTQAsetting=zero-shot2023.0536.14
OLTQA (w/o Pm)setting=zero-shot2023.0533.68
OLTQA (w/o Pk)setting=zero-shot2023.0531.23
Muppetsetting=zero-shot2023.0530.42
UnifiedQAsetting=zero-shot2023.0528.77
EPRsetting=zero-shot2023.0528.77
ProQAsetting=zero-shot2023.0525.96
Hyperformer++setting=zero-shot2023.0525.26