Language Understanding on MMLU (All)
28.7AccuracyGPT-neo
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-neoSettings=Few-shot, Model Scale=1.3B2023.05 | 28.7 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=GPT-neo, Retriever=ANCE2023.05 | 26.6 | |
| OPTSettings=Few-shot, Model Scale=1.3B2023.05 | 26 | |
| GPT-neoSettings=Zero-shot, Model Scale=1.3B2023.05 | 25.3 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=GPT-neo, Retriever=Contriever2023.05 | 25.2 | |
| GPT-neo GenReadSettings=Zero-shot, Model Scale=1.3B2023.05 | 24.4 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=OPT, Retriever=ANCE2023.05 | 23.7 | |
| AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=OPT, Retriever=Contriever2023.05 | 23.2 | |
| OPTSettings=Zero-shot, Model Scale=1.3B2023.05 | 22.7 | |
| OPT GenReadSettings=Zero-shot, Model Scale=1.3B2023.05 | 22.3 |