Question Answering on Arc Challenge (Score)
56.1ARC ScoreDP
Evaluation results
| Method | Links | |
|---|---|---|
| DPModel Scale=Gemma 9B, Method=DP2026.04 | 56.1 | |
| Decoupled DiLoCoModel Scale=Gemma 9B, Method=DiLoCo2026.04 | 56.1 | |
| DPModel Scale=Gemma 5B, Method=DP2026.04 | 47.3 | |
| Decoupled DiLoCoModel Scale=Gemma 5B, Method=DiLoCo2026.04 | 47.2 | |
| Decoupled DiLoCoModel Scale=Gemma 2B, Method=DiLoCo2026.04 | 36.3 | |
| DPModel Scale=Gemma 2B, Method=DP2026.04 | 36.2 |