Natural Language Understanding on GLUE (MRPC, CoLA, RTE)
89.45MRPC ScoreDoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DoRABackbone=Gemma2-2b-it2026.02 | 89.45 | 85.33 | 89.89 | |
| LoRABackbone=Gemma2-2b-it2026.02 | 89.39 | 84.66 | 90.25 | |
| MELoRABackbone=Gemma2-2b-it2026.02 | 88.75 | 84.08 | 88.81 | |
| MoSLoRABackbone=Gemma2-2b-it2026.02 | 88.63 | 85.43 | 89.17 | |
| HydraLoRABackbone=Gemma2-2b-it2026.02 | 88.58 | 86.29 | 90.97 | |
| HydraLoRABackbone=Qwen2.5-3B2026.02 | 88.46 | 85.91 | 89.89 | |
| MoSLoRABackbone=Qwen2.5-3B2026.02 | 88.41 | 86.19 | 90.97 | |
| HypLoRABackbone=Qwen2.5-3B2026.02 | 88.23 | 87.34 | 90.25 | |
| LoRABackbone=Qwen2.5-3B2026.02 | 87.71 | 69.13 | 89.53 | |
| HypLoRABackbone=Gemma2-2b-it2026.02 | 87.25 | 84.08 | 87.36 | |
| AdaLoRABackbone=Gemma2-2b-it2026.02 | 84.17 | 83.03 | 87.36 | |
| BaseBackbone=Qwen2.5-3B2026.02 | 56.41 | 62.8 | 51.62 |