List your company

General NLP Evaluation Suite

Benchmarks

TaskDatasetSOTA resultTrendResults
General NLP Evaluation Suite (CMNLI, HellaSwag, PIQA, CHID, WinoGrande, CSQA, BoolQ, MMLU, CMMLU, RACE) Llama3-8B expanded to 48 layers (test)
5.13PPL
6