Factual Recall on MMLU (Accuracy)
58MMLU Factual Recall AccuracyOLMo 3
Evaluation results
| Method | Links | |
|---|---|---|
| OLMo 3Parameters=7B, Shots=02026.01 | 58 | |
| UnfilteredShots=02026.01 | 53 | |
| FilteredShots=02026.01 | 53 | |
| Filtered + Alignment UpsampledStrategy=E2E, Shots=02026.01 | 53 | |
| Misalignment UpsampledStrategy=Mid, Shots=02026.01 | 53 | |
| OLMo 2Parameters=7B, Shots=02026.01 | 53 | |
| Filtered + Alignment UpsampledStrategy=Mid, Shots=02026.01 | 52 | |
| Filtered + Alignment UpsampledStrategy=CPT, Shots=02026.01 | 52 | |
| Misalignment UpsampledStrategy=CPT, Shots=02026.01 | 52 | |
| Alignment UpsampledStrategy=E2E, Shots=02026.01 | 51 | |
| Misalignment UpsampledStrategy=E2E, Shots=02026.01 | 51 | |
| Alignment UpsampledStrategy=Mid, Shots=02026.01 | 47 | |
| Alignment UpsampledStrategy=CPT, Shots=02026.01 | 47 | |
| Llama 2Parameters=7B, Shots=02026.01 | 45 |