List your company

Natural Language Understanding on GLUE (CoLA, MRPC, QNLI, RTE, STS-B, SST-2)

96.5SST-2 AccuracyRandLoRA
94.10894.72995.3595.971Apr 23, 2026

Evaluation results

MethodLinks
RandLoRABackbone=RoBERTa-Large, Params (M)=1.78, Rank (r)=1002026.0496.590.167.794.785.392.387.8
Full Fine-TuningBackbone=RoBERTa-Large, Params (M)=354.312026.0496.489.567.594.784.792.187.5
LoRABackbone=RoBERTa-Large, Params (M)=1.77, Rank (r)=42026.0496.289.766.694.785.292.287.4
GiVABackbone=RoBERTa-Large, Params (M)=0.22, Rank (r)=8, Initialization strategy=TopSV-B2026.0496.290.367.594.784.591.687.5
VeRABackbone=RoBERTa-Large, Params (M)=0.26, Rank (r)=2562026.0496.189.868.694.883.29287.4
GiVABackbone=RoBERTa-Large, Params (M)=0.22, Rank (r)=8, Initialization strategy=SecSV-B2026.0496.189.4689582.391.687.1
GiVABackbone=RoBERTa-Large, Params (M)=0.22, Rank (r)=8, Initialization strategy=Rand-B2026.0496.189.86794.785.39287.5
RandLoRABackbone=RoBERTa-Base, Params (M)=0.72, Rank (r)=642026.0494.988.862.692.874.890.684.1
Full Fine-TuningBackbone=RoBERTa-Base, Params (M)=124.062026.0494.889.662.192.875.890.984.3
LoRABackbone=RoBERTa-Base, Params (M)=0.66, Rank (r)=42026.0494.787.759.292.774.890.583.3
VeRABackbone=RoBERTa-Base, Params (M)=0.16, Rank (r)=10242026.0494.588.262.392.573.690.683.6
GiVABackbone=RoBERTa-Base, Params (M)=0.08, Rank (r)=8, Initialization strategy=Rand-B2026.0494.589.361.692.374.890.583.8
GiVABackbone=RoBERTa-Base, Params (M)=0.08, Rank (r)=8, Initialization strategy=TopSV-B2026.0494.288.759.192.375.590.483.4
GiVABackbone=RoBERTa-Base, Params (M)=0.08, Rank (r)=8, Initialization strategy=SecSV-B2026.0494.289.46092.273.490.583.3