Science Question Answering on ARC (Verifiability Score)
81.19Verifiability ScoreR1
Evaluation Results
| Method | Links | |
|---|---|---|
| R1Executor=Strong Comm.2026.02 | 81.19 | |
| PhiExecutor=Strong Comm.2026.02 | 76.62 | |
| PhiExecutor=Full Comm.2026.02 | 69.7 | |
| GemmaExecutor=Strong Comm.2026.02 | 68.99 | |
| LlamaExecutor=Strong Comm.2026.02 | 63.96 | |
| PhiExecutor=Weak Comm.2026.02 | 62.78 | |
| R1Executor=Full Comm.2026.02 | 62.61 | |
| GemmaExecutor=Full Comm.2026.02 | 49.9 | |
| LlamaExecutor=Full Comm.2026.02 | 47.28 | |
| R1Executor=Weak Comm.2026.02 | 44.03 | |
| GemmaExecutor=Weak Comm.2026.02 | 30.8 | |
| LlamaExecutor=Weak Comm.2026.02 | 30.6 |