Code Reasoning on LiveCodeBench v4 (Pass@1)
28.71Pass@1Full Fine-Tuning
Evaluation results
| Method | Links | |
|---|---|---|
| Full Fine-TuningRank (r)=N/A, n=162026.06 | 28.71 | |
| LoRA-αRank (r)=256, n=162026.06 | 26.73 | |
| LoRA (10× LR)Rank (r)=256, n=162026.06 | 22.77 | |
| LoRARank (r)=256, n=162026.06 | 20.79 | |
| LoRA (10× LR)Rank (r)=64, n=162026.06 | 19.8 | |
| LoRA-αRank (r)=64, n=162026.06 | 19.8 | |
| LoRARank (r)=64, n=162026.06 | 14.85 |