Mathematics & Science Tasks on GPQA
0.511AccuracyLlama-3.1-405B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-3.1-405BModel Type=Instruct, Parameters=405B2025.02 | 0.511 | |
| Qwen2.5-72BModel Type=Instruct, Parameters=72B2025.02 | 0.49 | |
| Qwen2.5-VL-72BModel Type=Instruct, Parameters=72B2025.02 | 0.49 | |
| Llama-3.1-70BModel Type=Instruct, Parameters=70B2025.02 | 0.467 | |
| Qwen2-72BModel Type=Instruct, Parameters=72B2025.02 | 0.424 |