Downstream Task Suite
Benchmarks
TaskDatasetSOTA resultTrendResults
Downstream Task Suite (ARC-C, BoolQ, HellaSwag, MMLU, OBQA, PIQA, RTE, WinoGrande) zero-shot Qwen1.5-MoE-A2.7B
45ARC-C Accuracy
6
Downstream Task Suite (PIQA, ARC-e, HellaSwag, GPQA, Lambada, MMLU, BBH)
50.67PIQA
2