List your company
ResearchFormerly WizWand

Natural Language Generation on E2E

0.472METEORLoRA (r=4)
0.252560.309530.36650.42347Oct 30, 2021Jul 27, 2022Apr 23, 2023Jan 19, 2024Oct 15, 2024Jul 12, 2025Apr 9, 2026
Updated 6mo ago

Evaluation results

MethodLinks
LoRA (r=4)Model=GPT-2 Medium, # Params=393K2026.040.472——
LoRABackbone=GPT-2, # Trainable Parameters=0.39M, # Total Parameters=100%2021.100.46870.48.85
NOLAModel=GPT-2 Medium, # Params=350K2026.040.468——
DSEEBackbone=GPT-2, # Trainable Parameters=0.39M, # Total Parameters=50%2021.100.46669.58.74
DSEEBackbone=GPT-2, # Trainable Parameters=0.39M, # Total Parameters=80%2021.100.46569.48.78
SOLAR (r=4, 1→0.3)Model=GPT-2 Medium, # Params=30K (92% ↓)2026.040.464——
Fine-tuneBackbone=GPT-2, # Trainable Parameters=354.92M, # Total Parameters=100%2021.100.46268.28.62
Full-FTModel=GPT-2 Medium, # Params=355M2026.040.462——
AdaptersBackbone=GPT-2, # Trainable Parameters=11.48M, # Total Parameters=100%2021.100.46168.98.71
PrefixBackbone=GPT-2, # Trainable Parameters=0.35M, # Total Parameters=100%2021.100.46169.78.81
FT-Top2Backbone=GPT-2, # Trainable Parameters=25.19M, # Total Parameters=100%2021.100.4668.18.59
SOLAR (r=1, 0.1→0.1)Model=GPT-2 Medium, # Params=9K (98% ↓)2026.040.448——
LoRA (r=4)Model=GPT-2 Small, # Params=147K2026.040.297——
SOLAR (r=4, 1→0.3)Model=GPT-2 Small, # Params=15K (90% ↓)2026.040.297——
NOLAModel=GPT-2 Small, # Params=48K2026.040.291——
Full-FTModel=GPT-2 Small, # Params=124M2026.040.284——
SOLAR (r=1, 0.1→0.1)Model=GPT-2 Small, # Params=4K (97% ↓)2026.040.261——