Data-to-Text on DART 1.0 (test)
70.3METEORLoRA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LoRAModel Size=Mamba-2 130M, Type=Parameter based, Params (%)=0.762025.03 | 70.3 | 49.6 | |
| State-offset Tuning (h)Model Size=Mamba-2 130M, Type=State based, Params (%)=3.532025.03 | 70 | 46.3 | |
| State-offset Tuning (h) (low rank)Model Size=Mamba-2 130M, Type=State based, Params (%)=0.722025.03 | 69.8 | 47.9 | |
| Prefix-TuningModel Size=Mamba-2 130M, Type=Prompt based, Params (%)=12.812025.03 | 69.2 | 46.5 | |
| Full Fine-tuning (All)Model Size=Mamba-2 130M, Type=None, Params (%)=100.002025.03 | 66.6 | 34.9 | |
| BitFitModel Size=Mamba-2 130M, Type=Parameter based, Params (%)=0.032025.03 | 66.2 | 39 | |
| State-offset Tuning (y)Model Size=Mamba-2 130M, Type=State based, Params (%)=0.032025.03 | 65.9 | 38.7 | |
| Full Fine-tuning (SSD)Model Size=Mamba-2 130M, Type=None, Params (%)=4.172025.03 | 65.7 | 39.7 | |
| Prompt TuningModel Size=Mamba-2 130M, Type=Prompt based, Params (%)=0.042025.03 | 65.5 | 36.9 | |
| Initial State TuningModel Size=Mamba-2 130M, Type=State based, Params (%)=3.532025.03 | 65.3 | 37.2 | |
| Additional-scanModel Size=Mamba-2 130M, Type=Parameter based, Params (%)=0.912025.03 | 58.5 | 16 |