Natural Language Understanding on GLUE (Average Score)
80.5GLUE Average ScoreFull Fine-tuning (All)
Evaluation Results
| Method | Links | |
|---|---|---|
| Full Fine-tuning (All)Model Size=Mamba 130M, Params (%)=100.00, Type=None2025.03 | 80.5 | |
| Full Fine-tuning (S6)Model Size=Mamba 130M, Params (%)=4.31, Type=None2025.03 | 79.3 | |
| State-offset Tuning (h)Model Size=Mamba 130M, Params (%)=0.45, Type=State-based2025.03 | 78.5 | |
| LoRAModel Size=Mamba 130M, Params (%)=0.92, Type=Parameter-based2025.03 | 78.3 | |
| BitFitModel Size=Mamba 130M, Params (%)=0.06, Type=Parameter-based2025.03 | 77.9 | |
| State-offset Tuning (y)Model Size=Mamba 130M, Params (%)=0.03, Type=State-based2025.03 | 77.7 | |
| Initial State TuningModel Size=Mamba 130M, Params (%)=0.45, Type=State-based2025.03 | 77.4 | |
| Prefix-TuningModel Size=Mamba 130M, Params (%)=22.69, Type=Prompt-based2025.03 | 68.6 | |
| Prompt TuningModel Size=Mamba 130M, Params (%)=0.04, Type=Prompt-based2025.03 | 63.8 | |
| Additional-scanModel Size=Mamba 130M, Params (%)=0.68, Type=Parameter-based2025.03 | 62.4 | |
| PretrainedModel Size=Mamba 130M, Params (%)=0.00, Type=None2025.03 | 41 |