Mathematical Reasoning on GSM8K (Exact Match)
47.23EM AccuracyFull Fine-tuning
Evaluation results
| Method | Links | |
|---|---|---|
| Full Fine-tuningModel Size=13B, Transfer Source=N/A2024.06 | 47.23 | |
| LoRA TuningModel Size=13B, Transfer Source=N/A2024.06 | 41.54 | |
| OursModel Size=13B, Transfer Source=7B2024.06 | 39.34 | |
| Proxy TuningModel Size=13B, Transfer Source=7B2024.06 | 37.68 | |
| Full Fine-tuningModel Size=13B, Transfer Source=7B2024.06 | 37.07 | |
| OursModel Size=13B, Transfer Source=1.1B2024.06 | 18.27 | |
| Proxy TuningModel Size=13B, Transfer Source=1.1B2024.06 | 16.91 | |
| Full Fine-tuningModel Size=13B, Transfer Source=1.1B2024.06 | 12.51 | |
| Base ModelModel Size=13B, Transfer Source=N/A2024.06 | 6.9 |