Zero-shot Evaluation on Arc-e, PIQA, Hellaswag, OpenBookQA, Winogrande, MMLU, and BoolQ Suite
53.83Arc-eBHyT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| BHyTTraining Stage=Pretrained & SFT, Model=Llama-3B2025.12 | 53.83 | 72.36 | 51.62 | 30.6 | 53.07 | 26.82 | 49.89 | 48.31 | |
| Peri-LNTraining Stage=Pretrained & SFT, Model=Llama-3B2025.12 | 50.19 | 70.93 | 48.39 | 31 | 51.98 | 26.36 | 42.43 | 45.9 | |
| BHyTTraining Stage=Pretrained-only, Model=Llama-3B2025.12 | 45.93 | 70.09 | 50.97 | 31.32 | 52.12 | 27.62 | 55.69 | 47.68 | |
| Peri-LNTraining Stage=Pretrained-only, Model=Llama-3B2025.12 | 41.03 | 68.93 | 47.47 | 30.64 | 51.7 | 27.02 | 47.19 | 44.85 |