Zero-shot Evaluation on Hellaswag, ARC-c, ARC-e, PIQA, BoolQ, and SciQ
29.23Hellaswag Accuracy (Zero-shot)Parcae
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ParcaeParameters=350M, T=8, Evaluation Protocol=Zero-shot2026.04 | 29.23 | 21.08 | 48.78 | 62.08 | 60.73 | 78.8 | 50.12 | |
| RDMParameters=350M, T=8, Evaluation Protocol=Zero-shot2026.04 | 28.55 | 20.9 | 47.26 | 61.75 | 61.53 | 76.7 | 49.45 | |
| ParcaeParameters=100M, T=16, Evaluation Protocol=Zero-shot2026.04 | 27.18 | 18.09 | 43.1 | 59.3 | 61.83 | 71.5 | 46.83 | |
| RDMParameters=100M, T=16, Evaluation Protocol=Zero-shot2026.04 | 27.16 | 17.66 | 42.38 | 59.14 | 51.35 | 72.5 | 45.03 |