Multiple Choice Question Answering on UNED-Access English 2024 (test)
92AccuracyOpenAI-o3-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OpenAI-o3-miniScenario=base, Setup=Zero-shot2025.02 | 92 | — | |
| Claude-3.5-SonnetScenario=base, Setup=Zero-shot2025.02 | 87 | — | |
| GPT-4oScenario=base, Setup=Zero-shot2025.02 | 85 | — | |
| GPT-4-TurboScenario=base, Setup=Zero-shot2025.02 | 84 | — | |
| OpenAI-o3-miniScenario=NOTO, Setup=Zero-shot2025.02 | 77 | 16.3 | |
| Gemma-2-27B-InstructScenario=base, Setup=Zero-shot2025.02 | 75 | — | |
| Llama-3-70B-InstructScenario=base, Setup=Zero-shot2025.02 | 75 | — | |
| Mixtral-8x22B-InstructScenario=base, Setup=Zero-shot2025.02 | 73 | — | |
| GPT-3.5-TurboScenario=base, Setup=Zero-shot2025.02 | 72 | — | |
| GPT-4oScenario=NOTO, Setup=Zero-shot2025.02 | 69 | 18.82 | |
| Mixtral-8x7B-InstructScenario=base, Setup=Zero-shot2025.02 | 69 | — | |
| Llama-3-8B-InstructScenario=base, Setup=Zero-shot2025.02 | 66 | — | |
| Mistral-7B-InstructScenario=base, Setup=Zero-shot2025.02 | 62 | — | |
| DeepSeek-R1-70BScenario=base, Setup=Zero-shot2025.02 | 60 | — | |
| Gemma-7B-InstructScenario=base, Setup=Zero-shot2025.02 | 59 | — | |
| GPT-4-TurboScenario=NOTO, Setup=Zero-shot2025.02 | 58 | 30.95 | |
| DeepSeek-R1-70BScenario=NOTO, Setup=Zero-shot2025.02 | 54 | 10 | |
| Claude-3.5-SonnetScenario=NOTO, Setup=Zero-shot2025.02 | 53 | 39.08 | |
| Llama-2-7B-ChatScenario=base, Setup=Zero-shot2025.02 | 52 | — | |
| Salamandra-7B-InstructScenario=base, Setup=Zero-shot2025.02 | 47 | — | |
| Llama-3-70B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 41 | 45.33 | |
| Gemma-2-27B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 40 | 46.67 | |
| Leniachat-Gemma-2BScenario=base, Setup=Zero-shot2025.02 | 40 | — | |
| Mixtral-8x7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 37 | 46.38 | |
| Llama-3-8B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 37 | 43.94 | |
| Mistral-7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 33 | 46.77 | |
| Llama-2-7B-ChatScenario=NOTO, Setup=Zero-shot2025.02 | 26 | 50 | |
| Mixtral-8x22B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 19 | 73.97 | |
| GPT-3.5-TurboScenario=NOTO, Setup=Zero-shot2025.02 | 14 | 80.56 | |
| Salamandra-7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 11 | 76.6 | |
| Gemma-7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 9 | 84.75 | |
| Leniachat-Gemma-2BScenario=NOTO, Setup=Zero-shot2025.02 | 3 | 92.5 |