ResearchBenchmarksNatural Language Understanding on GLUE (CoLA, RTE, MRPC, STS-B, SST-2, QNLI Subset)Follow80.46RTE AccuracySCALE79.492879.743979.99580.2461Jun 20, 2025Evaluation ResultsMethodMethodLinksRTE AccuracyCoLA AccuracyMRPC AccuracySTS-B ScoreSST-2 AccuracyQNLI AccuracyGLUE Average ScoreSCALEMemory consumption=0.3...Memory consumption=0.33G, Backbone=RoBERTa-base, Fine-tuning protocol=Full fine-tuning2025.0680.4663.0292.5391.2393.5892.2385.51AdamMemory consumption=0.7...Memory consumption=0.75G, Backbone=RoBERTa-base, Fine-tuning protocol=Full fine-tuning2025.0679.5363.3793.0191.2694.2692.6785.68