List your company

Language Understanding on HellaSwag, PIQA, MMLU Suite

49HellaSwag AccuracyOpenLLaMA (V1)
33.437.4541.545.55Dec 28, 2023

Evaluation results

MethodLinks
OpenLLaMA (V1)Parameters=3B2023.12497526.9549.9
INCITE (V1)Parameters=3B2023.12487426.7548.48
MobileLLaMAParameters=2.7B2023.12487527.349.23
MobileLLaMAParameters=1.4B2023.12437324.9744.9
OPTParameters=1.3B2023.12417124.6144.66
TinyLLaMA (2T)Parameters=1.1B2023.12407025.4144.84
PythiaParameters=1.4B2023.12407125.6845.77
GalacticaParameters=1.3B2023.12346326.7544.88