Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Reasoning on CMMLU benchmark leaderboard · SOTA2 Research

Research Benchmarks

Reasoning on CMMLU

0.5695Accuracy (Reasoning)FP16

Updated 1mo ago

Evaluation Results

Method	Links
FP162026.06		0.5695
LC-QAT2026.06		0.3646
PV-TUNING2026.06		0.3556

SOTA Paper

FP16

LC-QAT: Data-Efficient 2-Bit QAT for LLMs via Linear-Constrained Vector Quantization

Dataset

CMMLU

Follow for updates

Join SOTA2 Contact

Related Benchmarks

Zero-shot Question Answering on Reasoning Suite (ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, WinoGrande)Reasoning on CEVAL