ResearchBenchmarksNatural Language Understanding on GLUE (CoLA, MNLI, MRPC, QNLI, QQP, RTE, SST-2, STS-B)Follow56CoLA ScoreRW-SAM51.52852.68953.8555.011Sep 22, 2025Evaluation ResultsMethodMethodLinksCoLA ScoreMNLI ScoreMRPC ScoreQNLI ScoreQQP ScoreRTE ScoreSST-2 ScoreSTS-B ScoreAverage GLUE ScoreRW-SAMModel=DistilBERT, Eval...Model=DistilBERT, Evaluation Protocol=Fine-tuning2025.095682.690.489.687.262.591.58780.9AdamWModel=DistilBERT, Eval...Model=DistilBERT, Evaluation Protocol=Fine-tuning2025.0953.882.59088.486.862.891.486.480.4SAMModel=DistilBERT, Eval...Model=DistilBERT, Evaluation Protocol=Fine-tuning2025.0951.782.49089.487.16191.18780