General Language Understanding on BIG-bench Original
99.4Sports ScoreClaude 2.1
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Claude 2.1Evaluation Protocol=zero-shot2024.02 | 99.4 | 52.9 | 16.6 | 79.1 | 44.5 | |
| Llama 3-8bEvaluation Protocol=zero-shot2024.02 | 98.2 | 36.9 | 4.1 | 70.3 | 43.9 | |
| ChatGPTEvaluation Protocol=zero-shot2024.02 | 97.3 | 53.9 | 23.4 | 79.1 | 40.2 | |
| Llama 2-7bEvaluation Protocol=zero-shot2024.02 | 94.3 | 19.9 | 2 | 44.4 | 14.6 | |
| Llama 2-13bEvaluation Protocol=zero-shot2024.02 | 92.7 | 27.8 | 6.1 | 54.3 | 19.6 | |
| Mistral-8x7bEvaluation Protocol=zero-shot2024.02 | 92 | 39.7 | 10 | 63 | 29.6 | |
| GPT-4Evaluation Protocol=zero-shot2024.02 | 89.9 | 79.9 | 25.8 | 85.2 | 85 | |
| Mistral-7bEvaluation Protocol=zero-shot2024.02 | 88.8 | 27.1 | 15.7 | 53.1 | 12.5 | |
| GeminiEvaluation Protocol=zero-shot2024.02 | 86.7 | 68.8 | 10.3 | 80.2 | 20.8 | |
| Yi-34BEvaluation Protocol=zero-shot2024.02 | 62.7 | 25.9 | 3.1 | 71.6 | 29.2 | |
| Yi-6BEvaluation Protocol=zero-shot2024.02 | 50.1 | 21.1 | 3.1 | 34.6 | 3.9 |