Natural Language Generation on E2E
0.472METEORLoRA (r=4)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LoRA (r=4)Model=GPT-2 Medium, # Params=393K2026.04 | 0.472 | — | — | |
| LoRABackbone=GPT-2, # Trainable Parameters=0.39M, # Total Parameters=100%2021.10 | 0.468 | 70.4 | 8.85 | |
| NOLAModel=GPT-2 Medium, # Params=350K2026.04 | 0.468 | — | — | |
| DSEEBackbone=GPT-2, # Trainable Parameters=0.39M, # Total Parameters=50%2021.10 | 0.466 | 69.5 | 8.74 | |
| DSEEBackbone=GPT-2, # Trainable Parameters=0.39M, # Total Parameters=80%2021.10 | 0.465 | 69.4 | 8.78 | |
| SOLAR (r=4, 1→0.3)Model=GPT-2 Medium, # Params=30K (92% ↓)2026.04 | 0.464 | — | — | |
| Fine-tuneBackbone=GPT-2, # Trainable Parameters=354.92M, # Total Parameters=100%2021.10 | 0.462 | 68.2 | 8.62 | |
| Full-FTModel=GPT-2 Medium, # Params=355M2026.04 | 0.462 | — | — | |
| AdaptersBackbone=GPT-2, # Trainable Parameters=11.48M, # Total Parameters=100%2021.10 | 0.461 | 68.9 | 8.71 | |
| PrefixBackbone=GPT-2, # Trainable Parameters=0.35M, # Total Parameters=100%2021.10 | 0.461 | 69.7 | 8.81 | |
| FT-Top2Backbone=GPT-2, # Trainable Parameters=25.19M, # Total Parameters=100%2021.10 | 0.46 | 68.1 | 8.59 | |
| SOLAR (r=1, 0.1→0.1)Model=GPT-2 Medium, # Params=9K (98% ↓)2026.04 | 0.448 | — | — | |
| LoRA (r=4)Model=GPT-2 Small, # Params=147K2026.04 | 0.297 | — | — | |
| SOLAR (r=4, 1→0.3)Model=GPT-2 Small, # Params=15K (90% ↓)2026.04 | 0.297 | — | — | |
| NOLAModel=GPT-2 Small, # Params=48K2026.04 | 0.291 | — | — | |
| Full-FTModel=GPT-2 Small, # Params=124M2026.04 | 0.284 | — | — | |
| SOLAR (r=1, 0.1→0.1)Model=GPT-2 Small, # Params=4K (97% ↓)2026.04 | 0.261 | — | — |