Question Answering on TriviaQA Wiki (val)
87.6Exact Match (EM)Llama 2
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama 2Size=70B, Shots=5-shot2023.07 | 87.6 | |
| Llama 2Size=70B, Shots=64-shot2023.07 | 87.5 | |
| Llama 1Size=65B, Shots=64-shot2023.07 | 86 | |
| Llama 1Size=65B, Shots=5-shot2023.07 | 85.9 | |
| Llama 2Size=70B, Shots=1-shot2023.07 | 85 | |
| Llama 2Size=34B, Shots=64-shot2023.07 | 84.6 | |
| Llama 1Size=65B, Shots=1-shot2023.07 | 84.5 | |
| Llama 2Size=34B, Shots=5-shot2023.07 | 84.5 | |
| Llama 1Size=33B, Shots=5-shot2023.07 | 83.8 | |
| Llama 1Size=33B, Shots=64-shot2023.07 | 83.6 | |
| Llama 2Size=34B, Shots=1-shot2023.07 | 83.3 | |
| Llama 2Size=70B, Shots=0-shot2023.07 | 82.4 | |
| Llama 1Size=65B, Shots=0-shot2023.07 | 81.7 | |
| Llama 2Size=34B, Shots=0-shot2023.07 | 81 | |
| Llama 1Size=33B, Shots=1-shot2023.07 | 80.7 | |
| FalconSize=40B, Shots=5-shot2023.07 | 79.9 | |
| FalconSize=40B, Shots=64-shot2023.07 | 79.6 | |
| Llama 2Size=13B, Shots=5-shot2023.07 | 79.6 | |
| Llama 2Size=13B, Shots=64-shot2023.07 | 79.4 | |
| Llama 1Size=33B, Shots=0-shot2023.07 | 78.7 | |
| FalconSize=40B, Shots=1-shot2023.07 | 78.6 | |
| Llama 1Size=13B, Shots=64-shot2023.07 | 77.9 | |
| Llama 2Size=13B, Shots=1-shot2023.07 | 77.2 | |
| Llama 1Size=13B, Shots=5-shot2023.07 | 77.1 | |
| FalconSize=40B, Shots=0-shot2023.07 | 74.6 | |
| Llama 1Size=13B, Shots=1-shot2023.07 | 74.4 | |
| Llama 2Size=7B, Shots=64-shot2023.07 | 73.7 | |
| MPTSize=30B, Shots=64-shot2023.07 | 73.6 | |
| MPTSize=30B, Shots=5-shot2023.07 | 73.3 | |
| Llama 2Size=13B, Shots=0-shot2023.07 | 73.1 | |
| Llama 2Size=7B, Shots=5-shot2023.07 | 72.1 | |
| MPTSize=30B, Shots=1-shot2023.07 | 71.3 | |
| Llama 1Size=7B, Shots=64-shot2023.07 | 71 | |
| Llama 1Size=7B, Shots=5-shot2023.07 | 70.4 | |
| Llama 1Size=13B, Shots=0-shot2023.07 | 70.1 | |
| Llama 2Size=7B, Shots=1-shot2023.07 | 68.9 | |
| MPTSize=30B, Shots=0-shot2023.07 | 68 | |
| Llama 1Size=7B, Shots=1-shot2023.07 | 67.4 | |
| Llama 2Size=7B, Shots=0-shot2023.07 | 65.8 | |
| FalconSize=7B, Shots=5-shot2023.07 | 64.6 | |
| Llama 1Size=7B, Shots=0-shot2023.07 | 63.3 | |
| MPTSize=7B, Shots=64-shot2023.07 | 61.6 | |
| MPTSize=7B, Shots=5-shot2023.07 | 61.2 | |
| FalconSize=7B, Shots=64-shot2023.07 | 61.1 | |
| MPTSize=7B, Shots=1-shot2023.07 | 59.6 | |
| FalconSize=7B, Shots=1-shot2023.07 | 56.8 | |
| MPTSize=7B, Shots=0-shot2023.07 | 55.7 | |
| FalconSize=7B, Shots=0-shot2023.07 | 52.6 | |
| BaselineModel Scale=1B, Evaluation=3-shot2025.09 | 40 | |
| InductionModel Scale=1B, Evaluation=3-shot2025.09 | 30 | |
| Anti-inductionModel Scale=1B, Evaluation=3-shot2025.09 | 30 | |
| BalancedModel Scale=1B, Evaluation=3-shot2025.09 | 30 |