NLU Benchmark Suite
Benchmarks
TaskDatasetSOTA resultTrendResults
NLU Benchmark Suite CMNLI, HeSW, PIQA, WSC, CoQA, BoolQ, Race-M, Race-H, XSum, C3
34.43CMNLI Accuracy
8
NLU Benchmark Suite (SST2, COPA, CB, BoolQ, RTE, WiC) Pangu-1B (NPU) (val)
82.1SST2 Accuracy
6