Language Understanding on MMLU mimicked
72.5Algebra ScoreGPT-4
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-4zero-shot=true2024.02 | 72.5 | 91.6 | 76.3 | 85.2 | 91.6 | |
| Claude2.1zero-shot=true2024.02 | 52.6 | 70.2 | 54.4 | 62.5 | 75.6 | |
| Mistral-8x7bzero-shot=true2024.02 | 41.5 | 77.9 | 62.5 | 73.5 | 77.1 | |
| ChatGPTzero-shot=true2024.02 | 37.7 | 80.6 | 55 | 73.5 | 81.9 | |
| Yi-34Bzero-shot=true2024.02 | 37.6 | 82.6 | 58.9 | 71.9 | 79.7 | |
| Geminizero-shot=true2024.02 | 36.6 | 85.2 | 57.4 | 71.5 | 82 | |
| Llama3-8bzero-shot=true2024.02 | 35.5 | 81.4 | 59.4 | 70.2 | 81.4 | |
| Llama2-13bzero-shot=true2024.02 | 29 | 77.2 | 36 | 50.1 | 72 | |
| Mistral-7bzero-shot=true2024.02 | 27.9 | 77.1 | 45.7 | 59.3 | 74.4 | |
| Yi-6Bzero-shot=true2024.02 | 26.7 | 73.3 | 43.6 | 61.9 | 72.9 | |
| Llama2-7bzero-shot=true2024.02 | 17.2 | 68 | 32.3 | 49.8 | 60.6 |