Natural Language Understanding on GLUE (val) - Subset (CoLA, STS-B, MRPC, RTE, SST-2)
66.1CoLALoRA(r = 4)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LoRA(r = 4)TP=2.2M, Backbone=Llama3.2-1B2026.02 | 66.1 | 90.1 | 87.7 | 83.7 | 95.9 | |
| FineGatesTP=0.9M, Backbone=Llama3.2-1B2026.02 | 63.6 | 91.2 | 88.5 | 84.5 | 93.5 |