Disciplinary Knowledge on MMLU redux
0.2693AccuracyBD3LM
Evaluation results
| Method | Links | |
|---|---|---|
| BD3LMShots=5-shot, Number of Parameters=1B, Training Tokens=300B2026.01 | 0.2693 | |
| MDLMShots=5-shot, Number of Parameters=1B, Training Tokens=300B2026.01 | 0.2636 | |
| CARDShots=5-shot, Number of Parameters=1B, Training Tokens=300B2026.01 | 0.2565 | |
| ARMShots=5-shot, Number of Parameters=1B, Training Tokens=300B2026.01 | 0.2545 |