Text Generation on WikiText-103 (ROUGE-1)
0.391ROUGE-1Vanilla
Evaluation Results
| Method | Links | |
|---|---|---|
| VanillaBase Model=Qwen32026.05 | 0.391 | |
| VanillaBase Model=GPT-Neo2026.05 | 0.39 | |
| DiscreteBase Model=GPT-Neo2026.05 | 0.39 | |
| DiscreteBase Model=Qwen32026.05 | 0.388 | |
| NEFTuneBase Model=Qwen32026.05 | 0.388 | |
| Cont. (w/o DB)Base Model=Qwen32026.05 | 0.384 | |
| Cont. (w/ DB)Base Model=Qwen32026.05 | 0.384 | |
| VanillaBase Model=OPT2026.05 | 0.382 | |
| DiscreteBase Model=OPT2026.05 | 0.381 | |
| NEFTuneBase Model=OPT2026.05 | 0.381 | |
| NEFTuneBase Model=GPT-Neo2026.05 | 0.379 | |
| Cont. (w/o DB)Base Model=GPT-Neo2026.05 | 0.378 | |
| Cont. (w/ DB)Base Model=GPT-Neo2026.05 | 0.378 | |
| Cont. (w/o DB)Base Model=OPT2026.05 | 0.372 | |
| Cont. (w/ DB)Base Model=OPT2026.05 | 0.37 |