Short-context benchmarks
Benchmarks
TaskDatasetSOTA resultTrendResults
Short-context benchmarks ARC-C, ARC-E, PIQA, Winogrande, HellaSwag
63.48ARC-C Accuracy
45
Short Context Benchmarks MMLU, SciQ, OQA, CQA, SIQA, PIQA, HellaSwag, WinoGrande, ARC-c, ARC-e
74.25MMLU Accuracy
10