Boolean Question Answering on BoolQ (Score)
74.7Score (BoolQ)Decoupled DiLoCo
Evaluation results
| Method | Links | |
|---|---|---|
| Decoupled DiLoCoModel Scale=Gemma 9B, Method=DiLoCo2026.04 | 74.7 | |
| DPModel Scale=Gemma 9B, Method=DP2026.04 | 71.3 | |
| Decoupled DiLoCoModel Scale=Gemma 5B, Method=DiLoCo2026.04 | 68.8 | |
| DPModel Scale=Gemma 5B, Method=DP2026.04 | 65.5 | |
| DPModel Scale=Gemma 2B, Method=DP2026.04 | 58.8 | |
| Decoupled DiLoCoModel Scale=Gemma 2B, Method=DiLoCo2026.04 | 55.8 |