Text-to-SQL on Spider 1.0 (val)
64.8Accuracy (All)Full Fine-tuning (All)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Full Fine-tuning (All)Model Size=Mamba-2 1.3B, Type=None, Params (%)=100.002025.03 | 64.8 | 85.9 | 65.7 | 54 | 42.2 | |
| State-offset Tuning (h) (low rank)Model Size=Mamba-2 1.3B, Type=State based, Params (%)=0.352025.03 | 60.5 | 79 | 65.7 | 52.3 | 27.7 | |
| State-offset Tuning (h)Model Size=Mamba-2 1.3B, Type=State based, Params (%)=1.842025.03 | 58.5 | 79.3 | 61.6 | 44.6 | 33.7 | |
| Full Fine-tuning (SSD)Model Size=Mamba-2 1.3B, Type=None, Params (%)=2.422025.03 | 55.1 | 76.2 | 56.1 | 42.5 | 34.3 | |
| Initial State TuningModel Size=Mamba-2 1.3B, Type=State based, Params (%)=1.842025.03 | 54.3 | 73.4 | 57.2 | 45.4 | 27.1 | |
| BitFitModel Size=Mamba-2 1.3B, Type=Parameter based, Params (%)=0.022025.03 | 50.9 | 71.4 | 51.6 | 45.4 | 24.1 | |
| Prefix-TuningModel Size=Mamba-2 1.3B, Type=Prompt based, Params (%)=6.992025.03 | 47.4 | 71 | 48.2 | 32.2 | 25.9 | |
| LoRAModel Size=Mamba-2 1.3B, Type=Parameter based, Params (%)=0.372025.03 | 45.4 | 69 | 44.4 | 37.4 | 21.1 | |
| Prompt TuningModel Size=Mamba-2 1.3B, Type=Prompt based, Params (%)=0.012025.03 | 45.2 | 62.5 | 46.9 | 34.5 | 25.9 | |
| State-offset Tuning (y)Model Size=Mamba-2 1.3B, Type=State based, Params (%)=0.012025.03 | 43.6 | 66.5 | 42.1 | 36.9 | 21.1 | |
| Additional-scanModel Size=Mamba-2 1.3B, Type=Parameter based, Params (%)=0.472025.03 | 31.9 | 57.3 | 30.5 | 23 | 7.2 |