Language Modeling on WikiText-103 (Delta Score)
24.1WT-103 Delta (%)CE
Evaluation Results
| Method | Links | |
|---|---|---|
| CEBackbone=Qwen2.5-7B-Instruct, Adapter=SineLoRA2026.05 | 24.1 | |
| CEBackbone=Qwen2.5-7B-Instruct, Adapter=DoRA2026.05 | 22.8 | |
| CEBackbone=Qwen2.5-7B-Instruct, Adapter=LoRA2026.05 | 22.4 | |
| CEBackbone=Qwen2.5-7B-Instruct, Adapter=RandLoRA2026.05 | 18.5 | |
| no adaptationBackbone=Qwen2.5-7B-Instruct2026.05 | 9.02 | |
| CE + TMKLBackbone=Qwen2.5-7B-Instruct, Adapter=DoRA2026.05 | 1.8 | |
| CE + TMKLBackbone=Qwen2.5-7B-Instruct, Adapter=LoRA2026.05 | 1.5 | |
| CE + TMKLBackbone=Qwen2.5-7B-Instruct, Adapter=SineLoRA2026.05 | 1.1 | |
| CE + TMKLBackbone=Qwen2.5-7B-Instruct, Adapter=RandLoRA2026.05 | 0.5 |