Science Question Answering on ARC Challenge (Acc. and Final Gap)
78.4AccuracyPioneer Agent
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Pioneer AgentModel=Llama 3.2-3B, System Strategy=Agent, Checkpoint Stage=Best2026.04 | 78.4 | 22.6 | |
| Pioneer AgentModel=Llama 3.2-3B, System Strategy=Agent, Checkpoint Stage=C12026.04 | 74.2 | 22.6 | |
| Naive BaselineModel=Llama 3.2-3B, System Strategy=Naive, Checkpoint Stage=C42026.04 | 55.8 | 22.6 | |
| Naive BaselineModel=Llama 3.2-3B, System Strategy=Naive, Checkpoint Stage=C12026.04 | 52.9 | 22.6 |