List your company

Natural Language Understanding on GLUE RoBERTa LARGE (test dev)

90.57MNLI AccuracyLoRA
64.840471.520278.284.8798Oct 2, 2023Feb 12, 2024Jun 24, 2024Nov 4, 2024Mar 17, 2025Jul 28, 2025Dec 8, 2025

Evaluation results

MethodLinks
LoRAMemory=0.73G2025.1290.5790.9394.7895.9890.6891.3977.7264.3287.04
Full-AdamMemory=2.13G2025.1290.5191.994.4396.4491.692.7978.8164.8587.66
SCALEARN++Learning Setting=Two-stage MTL, Backbone=RoBERTa_LARGE2023.1090.3190.5994.0595.9392.4888.4886.2867.1388.16
GaLoreMemory=0.72G2025.1290.2789.9994.2196.191.1890.9477.1162.5286.54
SCALEARNUNIFORMLearning Setting=Two-stage MTL, Backbone=RoBERTa_LARGE2023.1090.1190.0594.2395.4192.1188.6384.466.9887.74
SCALEARNLearning Setting=Two-stage MTL, Backbone=RoBERTa_LARGE2023.1090.0990.5194.1895.4192.3288.0987.0865.487.91
SCALEARNUNIFORM++Learning Setting=Two-stage MTL, Backbone=RoBERTa_LARGE2023.1090.0890.4994.1295.1892.1290.0584.9864.9787.75
HYPERFORMER++Learning Setting=Joint MTL, Backbone=RoBERTa_LARGE2023.1089.7989.5493.9595.2291.6288.0786.2865.1687.45
PROPETLLearning Setting=STL, Backbone=RoBERTa_LARGE2023.1089.7889.2394.3295.4191.4587.6584.5565.8587.28
FOAMMemory=0.71G2025.1289.7489.6593.8895.7592.4492.3383.0364.387.64
LORALearning Setting=STL, Backbone=RoBERTa_LARGE2023.1089.6689.6694.295.4791.9887.780.5163.886.62
HYPERFORMERLearning Setting=Joint MTL, Backbone=RoBERTa_LARGE2023.1089.6690.1593.9595.891.6886.686.2861.1886.91
APOLLOMemory=0.72G2025.1289.6589.2793.6195.0691.6692.1480.1461.1386.58
ADAPTERLearning Setting=STL, Backbone=RoBERTa_LARGE2023.1089.6289.8794.1395.2491.8187.8281.2364.0786.72
FINETUNELearning Setting=STL, Backbone=RoBERTa_LARGE2023.1089.5789.7593.9195.391.8986.2781.5260.1586.04
ADAPTERFUSIONLearning Setting=Two-stage MTL, Backbone=RoBERTa_LARGE2023.1089.5790.8894.1595.8791.8688.9785.766.3987.93
COMPACTER++Learning Setting=STL, Backbone=RoBERTa_LARGE2023.1089.1587.3392.9395.4191.4687.8479.7165.6686.19
ADAPTER-MLearning Setting=Joint MTL, Backbone=RoBERTa_LARGE2023.1089.189.3593.6494.988.483.0986.6456.3885.19
PROPETL-MLearning Setting=Joint MTL, Backbone=RoBERTa_LARGE2023.1088.9889.0394.1495.1591.5687.8388.4560.9987.01
(IA)3Learning Setting=STL, Backbone=RoBERTa_LARGE2023.1088.6987.7991.7294.9591.3986.3780.7964.785.8
FINETUNE-MLearning Setting=Joint MTL, Backbone=RoBERTa_LARGE2023.1087.9589.8292.5894.8887.0481.3784.3655.3284.16
ADAPTERSOUPLearning Setting=Two-stage MTL, Backbone=RoBERTa_LARGE2023.1065.8382.3774.0693.9881.6773.3767.2743.772.78