Mathematical Reasoning on GSM8K (Knowledge Recall, Skill Accuracy)
78Knowledge RecallCorDA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CorDABackbone=Mistral-7B, # Facts=1002026.05 | 78 | 41.24 | |
| CorDABackbone=Mistral-7B, # Facts=2502026.05 | 69.6 | 35.37 | |
| LoRABackbone=Mistral-7B, # Facts=2502026.05 | 66.8 | 41.4 | |
| CorDABackbone=Mistral-7B, # Facts=5002026.05 | 66.4 | 25.02 | |
| PALoRABackbone=Mistral-7B, # Facts=2502026.05 | 65.6 | 46.17 | |
| PALoRABackbone=Mistral-7B, # Facts=5002026.05 | 65.6 | 46.93 | |
| CorDABackbone=Mistral-7B, # Facts=10002026.05 | 65.2 | 23.96 | |
| PALoRABackbone=Mistral-7B, # Facts=10002026.05 | 64.5 | 44.58 | |
| LoRABackbone=Mistral-7B, # Facts=10002026.05 | 63.9 | 39.27 | |
| LoRABackbone=Mistral-7B, # Facts=1002026.05 | 63 | 39.12 | |
| LoRABackbone=Mistral-7B, # Facts=5002026.05 | 63 | 41.7 | |
| PALoRABackbone=Mistral-7B, # Facts=1002026.05 | 63 | 46.4 | |
| OPLoRABackbone=Mistral-7B, # Facts=1002026.05 | 60 | 42.99 | |
| OPLoRABackbone=Mistral-7B, # Facts=2502026.05 | 56.8 | 42.38 | |
| OPLoRABackbone=Mistral-7B, # Facts=10002026.05 | 52.7 | 40.11 | |
| OPLoRABackbone=Mistral-7B, # Facts=5002026.05 | 52 | 42 |