Question Answering on Arc Easy (Score)
81.6ScoreDP
Evaluation results
| Method | Links | |
|---|---|---|
| DPModel Scale=Gemma 9B, Method=DP2026.04 | 81.6 | |
| Decoupled DiLoCoModel Scale=Gemma 9B, Method=DiLoCo2026.04 | 80.4 | |
| Decoupled DiLoCoModel Scale=Gemma 5B, Method=DiLoCo2026.04 | 73.8 | |
| DPModel Scale=Gemma 5B, Method=DP2026.04 | 73.6 | |
| DPModel Scale=Gemma 2B, Method=DP2026.04 | 65.1 | |
| Decoupled DiLoCoModel Scale=Gemma 2B, Method=DiLoCo2026.04 | 64 |