Scientific Reasoning on GPQA-D (hold-out)
76.82AccuracyTRINITY
Evaluation results
| Method | Links | |
|---|---|---|
| TRINITYZero-shot=true2025.12 | 76.82 | |
| Gemini Pro 2.5Zero-shot=true2025.12 | 75.25 | |
| GPT-5Zero-shot=true2025.12 | 72.73 | |
| Claude-4-SonnetZero-shot=true2025.12 | 67.3 | |
| Qwen3-32BZero-shot=true, Evaluation Mode=reasoning2025.12 | 59.09 | |
| Qwen3-32BZero-shot=true, Evaluation Mode=direct2025.12 | 54.05 | |
| DeepSeek-R1-Qwen-32BZero-shot=true2025.12 | 51.01 | |
| Gemma-3-27B-ITZero-shot=true2025.12 | 33.33 |