List your company

Language Modeling on WikiText-103 (PPL and Mauve)

72Perplexity (PPL)Continuous Perturbation (w/o DB)
68.5292.01115.5138.99May 13, 2026

Evaluation results

MethodLinks
Continuous Perturbation (w/o DB)Base Model=Qwen32026.057251
Continuous Perturbation (w/ DB)Base Model=Qwen32026.057350
Continuous Perturbation (w/ DB)Base Model=GPT-Neo2026.057668
NEFTuneBase Model=GPT-Neo2026.057769
Continuous Perturbation (w/o DB)Base Model=GPT-Neo2026.057768
VanillaBase Model=GPT-Neo2026.057883
Discrete PerturbationBase Model=GPT-Neo2026.058781
NEFTuneBase Model=Qwen32026.059577
VanillaBase Model=Qwen32026.059776
Discrete PerturbationBase Model=Qwen32026.0511375
Continuous Perturbation (w/ DB)Base Model=OPT2026.0512962
Continuous Perturbation (w/o DB)Base Model=OPT2026.0513260
VanillaBase Model=OPT2026.0514577
NEFTuneBase Model=OPT2026.0515079
Discrete PerturbationBase Model=OPT2026.0515979