Arithmetic Reasoning on MAWPS (test)
91.6AccuracyDoRA + MoDEK
Evaluation results
| Method | Links | |
|---|---|---|
| DoRA + MoDEKBackbone=LLaMA3-8B2024.10 | 91.6 | |
| LoRAALL + MoDEKBackbone=LLaMA3-8B2024.10 | 91.3 | |
| DoRABackbone=LLaMA3-8B2024.10 | 91.2 | |
| LoRAALLBackbone=LLaMA3-8B2024.10 | 90.8 | |
| LoRA¬K + MoDEK (+0.04%)Backbone=LLaMA3-8B2024.10 | 90.8 | |
| LoRA¬KBackbone=LLaMA3-8B2024.10 | 90.2 | |
| REFTBackbone=LLaMA3-8B2024.10 | 88.5 | |
| LoRA¬K + MoDEK (+0.04%)Backbone=LLaMA2-7B2024.10 | 63.7 | |
| DoRA + MoDEKBackbone=LLaMA2-7B2024.10 | 63.4 | |
| LoRAALL + MoDEKBackbone=LLaMA2-7B2024.10 | 63.1 | |
| DoRABackbone=LLaMA2-7B2024.10 | 62.9 | |
| LoRAALLBackbone=LLaMA2-7B2024.10 | 62.6 | |
| LoRA¬KBackbone=LLaMA2-7B2024.10 | 61.7 | |
| REFTBackbone=LLaMA2-7B2024.10 | 59.6 |