Text Generation on WikiText-2 (ROUGE-1)
39.1ROUGE-1Vanilla
Evaluation Results
| Method | Links | |
|---|---|---|
| VanillaBase Model=Qwen32026.05 | 39.1 | |
| VanillaBase Model=GPT-Neo2026.05 | 39 | |
| DiscreteBase Model=GPT-Neo2026.05 | 39 | |
| DiscreteBase Model=Qwen32026.05 | 38.8 | |
| NEFTuneBase Model=Qwen32026.05 | 38.8 | |
| Cont. (w/o DB)Base Model=Qwen32026.05 | 38.4 | |
| Cont. (w/ DB)Base Model=Qwen32026.05 | 38.4 | |
| VanillaBase Model=OPT2026.05 | 38.2 | |
| DiscreteBase Model=OPT2026.05 | 38.1 | |
| NEFTuneBase Model=OPT2026.05 | 38.1 | |
| NEFTuneBase Model=GPT-Neo2026.05 | 37.9 | |
| Cont. (w/o DB)Base Model=GPT-Neo2026.05 | 37.8 | |
| Cont. (w/ DB)Base Model=GPT-Neo2026.05 | 37.8 | |
| Cont. (w/o DB)Base Model=OPT2026.05 | 37.2 | |
| Cont. (w/ DB)Base Model=OPT2026.05 | 37 |