List your company

Text Generation on WikiText-2 (ROUGE-1)

39.1ROUGE-1Vanilla
36.91637.48338.0538.617May 13, 2026

Evaluation results

MethodLinks
VanillaBase Model=Qwen32026.0539.1
VanillaBase Model=GPT-Neo2026.0539
DiscreteBase Model=GPT-Neo2026.0539
DiscreteBase Model=Qwen32026.0538.8
NEFTuneBase Model=Qwen32026.0538.8
Cont. (w/o DB)Base Model=Qwen32026.0538.4
Cont. (w/ DB)Base Model=Qwen32026.0538.4
VanillaBase Model=OPT2026.0538.2
DiscreteBase Model=OPT2026.0538.1
NEFTuneBase Model=OPT2026.0538.1
NEFTuneBase Model=GPT-Neo2026.0537.9
Cont. (w/o DB)Base Model=GPT-Neo2026.0537.8
Cont. (w/ DB)Base Model=GPT-Neo2026.0537.8
Cont. (w/o DB)Base Model=OPT2026.0537.2
Cont. (w/ DB)Base Model=OPT2026.0537