Science Question Answering on ARC (Accuracy, Reusability, Verifiability)
95AccuracyDeepSeek-R1
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-R12026.02 | 95 | 32 | 63 | |
| Gemma32026.02 | 93 | 36 | 50 | |
| Llama3.12026.02 | 83 | 43 | 47 | |
| Phi4-Reasoning2026.02 | 81 | 43 | 70 |
Loading the SOTA2 catalog…