List your company
ResearchFormerly WizWand

Generative Task on Alpaca random subset of 1,000 samples

3.19PerplexityGenFT
3.014.2255.446.655May 21, 2025
Updated 5mo ago

Evaluation results

MethodLinks
GenFTStep=40, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.053.19
GenFTStep=35, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.053.23
PiSSAStep=40, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.25
PiSSAStep=35, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.27
GenFTStep=30, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.053.33
PiSSAStep=30, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.38
GenFTStep=25, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.053.4
PiSSAStep=25, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.56
LoRAStep=40, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.62
GenFTStep=20, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.053.63
LoRAStep=35, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.71
LoRAStep=30, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.97
PiSSAStep=20, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.053.99
GenFTStep=15, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.054.45
LoRAStep=25, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.054.54
PiSSAStep=15, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.054.68
LoRAStep=20, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.055.27
GenFTStep=10, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.055.64
PiSSAStep=10, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.055.84
LoRAStep=15, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.056.18
LoRAStep=10, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.057.08
PiSSAStep=5, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.057.15
LoRAStep=5, Backbone=LLaMA-7B, Param.(M)=4.2 M2025.057.64
GenFTStep=5, Backbone=LLaMA-7B, Param.(M)=2.6 M2025.057.69