List your company
ResearchFormerly WizWand

Question Answering on TriviaQA filtered (dev)

0.73Exact MatchLLaMA
0.42320.502850.58250.66215Feb 27, 2023
Updated 8mo ago

Evaluation results

MethodLinks
LLaMANumber of Parameters=65B, Number of Shots=642023.020.73
LLaMANumber of Parameters=65B, Number of Shots=52023.020.726
LLaMANumber of Parameters=65B, Number of Shots=12023.020.716
LLaMANumber of Parameters=33B, Number of Shots=642023.020.704
LLaMANumber of Parameters=33B, Number of Shots=52023.020.699
LLaMANumber of Parameters=65B, Number of Shots=02023.020.682
LLaMANumber of Parameters=33B, Number of Shots=12023.020.679
LLaMANumber of Parameters=33B, Number of Shots=02023.020.651
ChinchillaNumber of Parameters=70B, Number of Shots=642023.020.646
ChinchillaNumber of Parameters=70B, Number of Shots=52023.020.641
LLaMANumber of Parameters=13B, Number of Shots=642023.020.64
LLaMANumber of Parameters=13B, Number of Shots=52023.020.631
LLaMANumber of Parameters=13B, Number of Shots=12023.020.605
LLaMANumber of Parameters=7B, Number of Shots=642023.020.576
GopherNumber of Parameters=280B, Number of Shots=642023.020.572
GopherNumber of Parameters=280B, Number of Shots=52023.020.57
LLaMANumber of Parameters=13B, Number of Shots=02023.020.566
LLaMANumber of Parameters=7B, Number of Shots=52023.020.563
ChinchillaNumber of Parameters=70B, Number of Shots=02023.020.554
LLaMANumber of Parameters=7B, Number of Shots=12023.020.534
LLaMANumber of Parameters=7B, Number of Shots=02023.020.5
GopherNumber of Parameters=280B, Number of Shots=02023.020.435