Human Proficiency Exam on AP Exams
86.7AP Art History ScoreLlama 3 405B
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Llama 3 405Bprompting=few-shot2024.07 | 86.7 | 100 | 88.6 | 90.6 | 94.3 | 83.3 | 93.5 | 98.3 | 93.8 | 92.9 | 100 | 85.2 | 97.6 | 97.6 | 100 | 93.5 | |
| Llama 3 70Bprompting=few-shot2024.07 | 84.4 | 100 | 54.3 | 96.9 | 90.6 | 79.6 | 89.1 | 98.3 | 91.7 | 78.6 | 100 | 59.3 | 97.6 | 97.6 | 100 | 87.9 | |
| GPT-4oprompting=few-shot2024.07 | 80 | 100 | 91.4 | 93.8 | 98.1 | 88.9 | 89.1 | 96.5 | 97.9 | 71.4 | 100 | 92.6 | 100 | 95.1 | 100 | 93 | |
| Claude 3.5 Sonnetprompting=few-shot2024.07 | 77.8 | 100 | 88.6 | 96.9 | 90.6 | 85.2 | 84.8 | 94.8 | 97.9 | 78.6 | 100 | 96.3 | 100 | 95.1 | 97.1 | 92.2 | |
| Llama 3 8Bprompting=few-shot2024.07 | 75.6 | 91.7 | 57.1 | 59.4 | 69.8 | 59.3 | 73.9 | 72.4 | 70.8 | 57.1 | 94.8 | 66.7 | 90.2 | 78 | 94.1 | 74.1 | |
| Nemotron 4 340Bprompting=few-shot2024.07 | 71.1 | 95.8 | 68.6 | 68.8 | 88.7 | 88.9 | 73.9 | 91.4 | 89.6 | 71.4 | 100 | 77.8 | 78 | 70.7 | 85.3 | 81.3 | |
| GPT-3.5 Turboprompting=few-shot2024.07 | 68.9 | 91.7 | 62.9 | 62.5 | 77.4 | 53.7 | 73.9 | 67.2 | 64.6 | 35.7 | 94.8 | 48.1 | 78 | 85.4 | 88.2 | 70.2 |