Question Answering on TriviaQA filtered (dev)
0.73Exact MatchLLaMA
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaMANumber of Parameters=65B, Number of Shots=642023.02 | 0.73 | |
| LLaMANumber of Parameters=65B, Number of Shots=52023.02 | 0.726 | |
| LLaMANumber of Parameters=65B, Number of Shots=12023.02 | 0.716 | |
| LLaMANumber of Parameters=33B, Number of Shots=642023.02 | 0.704 | |
| LLaMANumber of Parameters=33B, Number of Shots=52023.02 | 0.699 | |
| LLaMANumber of Parameters=65B, Number of Shots=02023.02 | 0.682 | |
| LLaMANumber of Parameters=33B, Number of Shots=12023.02 | 0.679 | |
| LLaMANumber of Parameters=33B, Number of Shots=02023.02 | 0.651 | |
| ChinchillaNumber of Parameters=70B, Number of Shots=642023.02 | 0.646 | |
| ChinchillaNumber of Parameters=70B, Number of Shots=52023.02 | 0.641 | |
| LLaMANumber of Parameters=13B, Number of Shots=642023.02 | 0.64 | |
| LLaMANumber of Parameters=13B, Number of Shots=52023.02 | 0.631 | |
| LLaMANumber of Parameters=13B, Number of Shots=12023.02 | 0.605 | |
| LLaMANumber of Parameters=7B, Number of Shots=642023.02 | 0.576 | |
| GopherNumber of Parameters=280B, Number of Shots=642023.02 | 0.572 | |
| GopherNumber of Parameters=280B, Number of Shots=52023.02 | 0.57 | |
| LLaMANumber of Parameters=13B, Number of Shots=02023.02 | 0.566 | |
| LLaMANumber of Parameters=7B, Number of Shots=52023.02 | 0.563 | |
| ChinchillaNumber of Parameters=70B, Number of Shots=02023.02 | 0.554 | |
| LLaMANumber of Parameters=7B, Number of Shots=12023.02 | 0.534 | |
| LLaMANumber of Parameters=7B, Number of Shots=02023.02 | 0.5 | |
| GopherNumber of Parameters=280B, Number of Shots=02023.02 | 0.435 |