List your company

Natural Language Understanding on GLUE (8-Task Subset: CoLA, SST-2, MRPC, QQP, MNLI, QNLI, RTE, STS-B)

66.7CoLA AccuracyMP-ISMoE† (T5-large)
-2.66815.34133.3551.359Apr 10, 2026

Evaluation results

MethodLinks
MP-ISMoE† (T5-large)Backbone=T5-large, Params (%)=1.75, Memory Train (G)=9.9, Memory Test (G)=2.822026.0466.796.593.19088.794.779.892.487.7
MP-ISMoE‡ (T5-large)Backbone=T5-large, Params (%)=0.81, Memory Train (G)=7.6, Memory Test (G)=2.802026.0466.496.593.490.388.994.981.692.788.1
UniPT (T5-large)Backbone=T5-large, Params (%)=0.92, Memory Train (G)=9.1, Memory Test (G)=2.822026.0465.795.89289.788.294.279.69287.2
SHERL (T5-large)Backbone=T5-large, Params (%)=0.64, Memory Train (G)=7.1, Memory Test (G)=2.802026.0465.695.892.989.688.694.280.892.187.5
LST (T5-large)Backbone=T5-large, Params (%)=1.23, Memory Train (G)=12.2, Memory Test (G)=2.882026.0465.395.791.689.788.694.179.992.487.1
AdapterBackbone=T5-base, Params (%)=1.63, Memory Train (G)=13.0, Memory Test (G)=0.872026.0464.494.288.988.986.493.175.191.185.3
MP-ISMoE†Backbone=T5-base, Params (%)=2.41, Memory Train (G)=3.2, Memory Test (G)=0.862026.0463.494.691.689.185.793.470.99084.8
LoRABackbone=T5-base, Params (%)=1.71, Memory Train (G)=12.6, Memory Test (G)=0.862026.0463.394.390.18986.393.275.590.985.3
Fully-FTBackbone=T5-base, Params (%)=100, Memory Train (G)=17.6, Memory Test (G)=0.862026.0462.893.991.989.986.292.574.190.385.2
MP-ISMoE‡Backbone=T5-base, Params (%)=1.48, Memory Train (G)=3.3, Memory Test (G)=0.872026.0462.494.389.689.385.993.272.891.584.9
UniPTBackbone=T5-base, Params (%)=1.36, Memory Train (G)=2.9, Memory Test (G)=0.862026.0462.294.290.888.985.593.369.889.784.3
BitFitBackbone=T5-base, Params (%)=0.13, Memory Train (G)=10.7, Memory Test (G)=0.862026.0461.894.39188.785.693.167.690.884.1
SHERLBackbone=T5-base, Params (%)=0.85, Memory Train (G)=2.9, Memory Test (G)=0.872026.0461.193.789.488.885.393.371.990.984.3
LSTBackbone=T5-base, Params (%)=1.74, Memory Train (G)=5.5, Memory Test (G)=0.882026.0458.194.190.488.885.693.371.990.784.1
PromptBackbone=T5-base, Params (%)=0.03, Memory Train (G)=22.2, Memory Test (G)=0.872026.04090.374.688.582.592.559.590.172.2