List your company

Natural Language Understanding on GLUE (test) (CoLA, SST-2, MRPC, QQP, MNLI, QNLI, RTE)

0.5203CoLA ScoreIndividual
-0.0680280.0847110.237450.390189Apr 30, 2026

Evaluation results

MethodLinks
IndividualBackbone=Mamba-130M2026.040.52030.91970.7770.88640.8210.87940.67510.7827
Traditional MTLBackbone=Mamba-130M2026.040.51680.91060.77210.86990.78330.86270.66790.769
Auto-FlexSwitch+MSEType=Dynamic, Storage (MB)=23.90, Backbone=Mamba-130M, lambda=0.92026.040.51190.91280.77450.87830.7880.86990.65340.7698
Twin-mergingType=Dynamic, Storage (MB)=795.29, Backbone=Mamba-130M2026.040.50840.91740.77430.87590.78290.87060.65310.7689
Auto-FlexSwitch+CKAType=Dynamic, Storage (MB)=61.60, Backbone=Mamba-130M, lambda=502026.040.50750.91630.77680.88480.80110.87420.65340.7734
Auto-FlexSwitch+KLType=Dynamic, Storage (MB)=34.96, Backbone=Mamba-130M, lambda=52026.040.50680.91510.78920.88120.790.8730.64980.7722
Auto-SwitchType=Dynamic, Storage (MB)=216.46, Backbone=Mamba-130M2026.040.4950.91860.75490.87860.78450.84240.65310.761
EMR-mergingType=Dynamic, Storage (MB)=600.37, Backbone=Mamba-130M2026.040.48910.91170.75250.83830.80530.84950.6570.7576
AdaMerging++Type=Static, Backbone=Mamba-130M2026.040.29170.75460.68140.54260.55050.64420.61430.5828
Ties-MergingType=Static, Backbone=Mamba-130M2026.040.20150.74890.6740.61750.55340.66740.65340.588
RegMeanType=Static, Backbone=Mamba-130M2026.040.19470.88760.68870.80660.50080.68770.62450.6272
AdaMergingType=Static, Backbone=Mamba-130M2026.040.15660.68230.64460.52210.59830.61890.6170.5485
Task-ArithmeticType=Static, Backbone=Mamba-130M2026.040.15160.74770.64460.61650.56620.66610.64260.5765
DF-MergeType=Static, Backbone=Mamba-130M2026.040.14230.81650.69360.46680.59540.53940.61370.5525
DAREType=Static, Backbone=Mamba-130M2026.040.13840.81770.60050.53750.63760.64380.63180.5725
Fisher MergingType=Static, Backbone=Mamba-130M2026.040.0980.76950.64460.67870.4340.58430.60290.5446
Weight-AveragingType=Static, Backbone=Mamba-130M2026.040.03520.73510.62990.65230.40770.57130.59930.5187
Pre-trainedBackbone=Mamba-130M2026.04-0.04540.4920.6250.6220.32110.49390.54510.4362