ResearchBenchmarksNatural Language Understanding on GLUE (test) (SST-2, MNLI, MRPC, CoLA, QNLI, QQP, STS-B)Follow82.44SST-2 AccuracyFRONT77.562478.828780.09581.3613Mar 8, 2026Evaluation ResultsMethodMethodLinksSST-2 AccuracyMNLI AccuracyMRPC AccuracyCoLA ScoreQNLI AccuracyQQP AccuracySTS-B ScoreGLUE Average ScoreFRONTBackbone=BERT-SBackbone=BERT-S2026.0382.4474.0868.4617.3870.8684.9354.2364.63ScratchBackbone=BERT-SBackbone=BERT-S2026.0378.9763.6566.428.1457.2181.517.2753.31KDBackbone=BERT-SBackbone=BERT-S2026.0377.7564.8164.149.145880.0715.7652.81