List your company
ResearchFormerly WizWand

Language Understanding on MMLU (All)

28.7AccuracyGPT-neo
22.04423.77225.527.228May 27, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GPT-neoSettings=Few-shot, Model Scale=1.3B2023.0528.7
AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=GPT-neo, Retriever=ANCE2023.0526.6
OPTSettings=Few-shot, Model Scale=1.3B2023.0526
GPT-neoSettings=Zero-shot, Model Scale=1.3B2023.0525.3
AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=GPT-neo, Retriever=Contriever2023.0525.2
GPT-neo GenReadSettings=Zero-shot, Model Scale=1.3B2023.0524.4
AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=OPT, Retriever=ANCE2023.0523.7
AARSettings=Zero-shot, Model Scale=1.3B, Backbone LM=OPT, Retriever=Contriever2023.0523.2
OPTSettings=Zero-shot, Model Scale=1.3B2023.0522.7
OPT GenReadSettings=Zero-shot, Model Scale=1.3B2023.0522.3