List your company

Natural Language Understanding on GLUE8 (val)

0.578CoLA ScoreLORA+
0.206720.303110.39950.49589May 31, 2026

Evaluation results

MethodLinks
LORA+SETTING=NON-DP, Backbone=Gemma-3-4B-pt2026.050.5780.950.840.8620.8070.8450.8510.8380.769
RITESETTING=NON-DP, Backbone=Gemma-3-4B-pt2026.050.5150.9470.8830.8730.8210.8460.8890.8950.782
ADAMWSETTING=NON-DP, Backbone=Gemma-3-4B-pt2026.050.5040.9540.8310.8630.7660.8130.8460.8480.752
LAMBSETTING=NON-DP, Backbone=Gemma-3-4B-pt2026.050.4680.9390.860.8720.7760.8420.8680.8560.756
FFASETTING=NON-DP, Backbone=Gemma-3-4B-pt2026.050.4560.9350.7590.8210.7130.7360.8090.8090.712
PRISMSETTING=ε = 6, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.4440.9190.7980.7180.770.7070.7760.7910.69
LORA+SETTING=ε = 6, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.4360.8970.7870.6910.7390.7210.7470.8230.674
LORA+SETTING=ε = 3, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.4340.9060.7980.6680.730.7080.740.8120.665
LAMBSETTING=ε = 6, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.4140.920.7560.5440.5210.6020.7090.7760.621
ADAMWSETTING=ε = 3, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.410.9030.7780.6220.5550.6330.7180.8120.634
ADAMWSETTING=ε = 6, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.4070.9150.770.6590.4930.6510.7160.7980.641
PRISMSETTING=ε = 3, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.4060.8840.7840.7290.770.7320.7910.780.68
LAMBSETTING=ε = 3, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.3960.9090.7590.5170.4860.5860.7080.7830.609
PRISMSETTING=NON-DP, Backbone=Gemma-3-4B-pt2026.050.3920.9210.8570.8220.7970.8140.8340.7980.737
FFASETTING=ε = 6, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.3550.9070.7380.4650.4790.5790.6840.7550.589
FFASETTING=ε = 3, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.3370.890.730.4060.4660.5610.6620.740.569
RITESETTING=ε = 6, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.2350.7870.6350.2680.50.4820.5620.6570.49
RITESETTING=ε = 3, Backbone=Gemma-3-4B-pt, δ=10^-52026.050.2210.7130.6360.260.4850.4630.5480.6060.462