Question Answering on MMMLU
36.14AccuracyOLTQA
Evaluation Results
| Method | Links | |
|---|---|---|
| OLTQAsetting=zero-shot2023.05 | 36.14 | |
| OLTQA (w/o Pm)setting=zero-shot2023.05 | 33.68 | |
| OLTQA (w/o Pk)setting=zero-shot2023.05 | 31.23 | |
| Muppetsetting=zero-shot2023.05 | 30.42 | |
| UnifiedQAsetting=zero-shot2023.05 | 28.77 | |
| EPRsetting=zero-shot2023.05 | 28.77 | |
| ProQAsetting=zero-shot2023.05 | 25.96 | |
| Hyperformer++setting=zero-shot2023.05 | 25.26 |