Mathematical Reasoning on GSM8K (Accuracy, 95% CI, Fisher's p, Odds Ratio, Accuracy gap)
77.13AccuracySDS-LoRA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SDS-LoRAModel=LLaMA3-8B, Rank=322026.06 | 77.13 | — | — | — | — | |
| Full FT.Model=LLaMA3-8B, Rank=-2026.06 | 77.04 | — | — | — | — | |
| SDS-LoRAModel=LLaMA3-8B, Rank=82026.06 | 76.42 | — | — | — | — | |
| DoRAModel=LLaMA3-8B, Rank=322026.06 | 76.42 | — | — | — | — | |
| PiSSAModel=LLaMA3-8B, Rank=322026.06 | 76.39 | — | — | — | — | |
| rsLoRAModel=LLaMA3-8B, Rank=322026.06 | 76.28 | — | — | — | — | |
| LoRA+Model=LLaMA3-8B, Rank=322026.06 | 76.11 | — | — | — | — | |
| rsLoRAModel=LLaMA3-8B, Rank=82026.06 | 75.71 | — | — | — | — | |
| DoRAModel=LLaMA3-8B, Rank=82026.06 | 75.41 | — | — | — | — | |
| LoRA+Model=LLaMA3-8B, Rank=82026.06 | 75.27 | — | — | — | — | |
| PiSSAModel=LLaMA3-8B, Rank=82026.06 | 74.96 | — | — | — | — | |
| LoRAModel=LLaMA3-8B, Rank=322026.06 | 73.49 | — | — | — | — | |
| LoRAModel=LLaMA3-8B, Rank=82026.06 | 73.44 | — | — | — | — | |
| entropy-trajectory monotonicitySubset=Monotone chains, n=221, Model=Qwen2.5-7B-Instruct2026.03 | 68.8 | 63 | 0.0005 | 2.5 | — | |
| entropy-trajectory monotonicitySubset=All chains, n=300, Model=Qwen2.5-7B-Instruct2026.03 | 63 | — | — | — | — | |
| Full FT.Model=Gemma-2B, Rank=-2026.06 | 56.23 | — | — | — | — | |
| SDS-LoRAModel=Gemma-2B, Rank=322026.06 | 55.21 | — | — | — | — | |
| PiSSAModel=Gemma-2B, Rank=322026.06 | 53.38 | — | — | — | — | |
| LoRA+Model=Gemma-2B, Rank=322026.06 | 52.74 | — | — | — | — | |
| DoRAModel=Gemma-2B, Rank=322026.06 | 52.41 | — | — | — | — | |
| SDS-LoRAModel=Gemma-2B, Rank=82026.06 | 52.01 | — | — | — | — | |
| rsLoRAModel=Gemma-2B, Rank=322026.06 | 51.93 | — | — | — | — | |
| PiSSAModel=Gemma-2B, Rank=82026.06 | 50.97 | — | — | — | — | |
| DoRAModel=Gemma-2B, Rank=82026.06 | 50.61 | — | — | — | — | |
| LoRA+Model=Gemma-2B, Rank=82026.06 | 50.3 | — | — | — | — | |
| rsLoRAModel=Gemma-2B, Rank=82026.06 | 49.1 | — | — | — | — | |
| entropy-trajectory monotonicitySubset=Non-monotone chains, n=79, Model=Qwen2.5-7B-Instruct2026.03 | 46.8 | 35.7 | — | — | — | |
| LoRAModel=Gemma-2B, Rank=322026.06 | 45.67 | — | — | — | — | |
| LoRAModel=Gemma-2B, Rank=82026.06 | 45.59 | — | — | — | — | |
| entropy-trajectory monotonicitySubset=Accuracy gap (monotone − non-monotone), Model=Qwen2.5-7B-Instruct2026.03 | — | 9.5 | — | — | 21.9 |