Multiple Choice Question Answering on UNED-Access Spanish 2024 (test)
93AccuracyOpenAI-o3-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OpenAI-o3-miniScenario=base, Setup=Zero-shot2025.02 | 93 | — | |
| Claude-3.5-SonnetScenario=base, Setup=Zero-shot2025.02 | 89 | — | |
| GPT-4-TurboScenario=base, Setup=Zero-shot2025.02 | 85 | — | |
| GPT-4oScenario=base, Setup=Zero-shot2025.02 | 84 | — | |
| OpenAI-o3-miniScenario=NOTO, Setup=Zero-shot2025.02 | 79 | 15.05 | |
| DeepSeek-R1-70BScenario=base, Setup=Zero-shot2025.02 | 77 | — | |
| Llama-3-70B-InstructScenario=base, Setup=Zero-shot2025.02 | 77 | — | |
| Gemma-2-27B-InstructScenario=base, Setup=Zero-shot2025.02 | 76 | — | |
| Mixtral-8x22B-InstructScenario=base, Setup=Zero-shot2025.02 | 74 | — | |
| Mixtral-8x7B-InstructScenario=base, Setup=Zero-shot2025.02 | 70 | — | |
| GPT-4oScenario=NOTO, Setup=Zero-shot2025.02 | 69 | 17.86 | |
| GPT-3.5-TurboScenario=base, Setup=Zero-shot2025.02 | 68 | — | |
| DeepSeek-R1-70BScenario=NOTO, Setup=Zero-shot2025.02 | 65 | 15.58 | |
| GPT-4-TurboScenario=NOTO, Setup=Zero-shot2025.02 | 65 | 23.53 | |
| Llama-3-8B-InstructScenario=base, Setup=Zero-shot2025.02 | 65 | — | |
| Claude-3.5-SonnetScenario=NOTO, Setup=Zero-shot2025.02 | 62 | 30.34 | |
| Mistral-7B-InstructScenario=base, Setup=Zero-shot2025.02 | 60 | — | |
| Gemma-7B-InstructScenario=base, Setup=Zero-shot2025.02 | 56 | — | |
| Llama-2-7B-ChatScenario=base, Setup=Zero-shot2025.02 | 48 | — | |
| Salamandra-7B-InstructScenario=base, Setup=Zero-shot2025.02 | 46 | — | |
| Gemma-2-27B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 41 | 46.05 | |
| Llama-3-70B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 41 | 46.75 | |
| Leniachat-Gemma-2BScenario=base, Setup=Zero-shot2025.02 | 37 | — | |
| Mistral-7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 34 | 43.33 | |
| Mixtral-8x7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 33 | 52.86 | |
| Llama-3-8B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 33 | 49.23 | |
| Mixtral-8x22B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 25 | 66.22 | |
| Salamandra-7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 16 | 65.22 | |
| Llama-2-7B-ChatScenario=NOTO, Setup=Zero-shot2025.02 | 15 | 68.75 | |
| GPT-3.5-TurboScenario=NOTO, Setup=Zero-shot2025.02 | 10 | 85.29 | |
| Gemma-7B-InstructScenario=NOTO, Setup=Zero-shot2025.02 | 9 | 83.93 | |
| Leniachat-Gemma-2BScenario=NOTO, Setup=Zero-shot2025.02 | 5 | 86.49 |