Mathematical Reasoning on GSM8K (ΔLL)
28.8Delta LL (GSM8K)CE
Evaluation Results
| Method | Links | |
|---|---|---|
| CEBackbone=7B, Adapter=DoRA2026.05 | 28.8 | |
| CEBackbone=7B, Adapter=LoRA2026.05 | 28.5 | |
| CEBackbone=7B, Adapter=SineLoRA2026.05 | 27.9 | |
| CEBackbone=0.5B, Adapter=DoRA2026.05 | 22.4 | |
| CEBackbone=7B, Adapter=RandLoRA2026.05 | 22.4 | |
| CEBackbone=0.5B, Adapter=LoRA2026.05 | 22.1 | |
| CEBackbone=0.5B, Adapter=SineLoRA2026.05 | 21.5 | |
| CEBackbone=0.5B, Adapter=RandLoRA2026.05 | 17.3 | |
| CE + TMKLBackbone=0.5B, Adapter=LoRA2026.05 | 0.5 | |
| CE + TMKLBackbone=0.5B, Adapter=DoRA2026.05 | 0.4 | |
| CE + TMKLBackbone=0.5B, Adapter=SineLoRA2026.05 | 0.3 | |
| CE + TMKLBackbone=7B, Adapter=DoRA2026.05 | 0.3 | |
| CE + TMKLBackbone=7B, Adapter=LoRA2026.05 | 0.2 | |
| CE + TMKLBackbone=7B, Adapter=SineLoRA2026.05 | 0.1 | |
| CE + TMKLBackbone=0.5B, Adapter=RandLoRA2026.05 | -0.1 | |
| CE + TMKLBackbone=7B, Adapter=RandLoRA2026.05 | -0.4 | |
| BaseBackbone=7B2026.05 | -1.245 | |
| BaseBackbone=0.5B2026.05 | -2.114 |