Mathematical Reasoning on GSM8K (GSM8K Acc %)
72.7GSM8K AccuracySVD
Evaluation Results
| Method | Links | |
|---|---|---|
| SVDModel Size (Billion)=13.02, Base Model=Llama 2-13B2025.07 | 72.7 | |
| FWSVDModel Size (Billion)=13.02, Base Model=Llama 2-13B2025.07 | 72.7 | |
| ASVDModel Size (Billion)=13.02, Base Model=Llama 2-13B2025.07 | 72.7 | |
| AFMModel Size (Billion)=13.02, Base Model=Llama 2-13B2025.07 | 72.7 | |
| IMPACTModel Size (Billion)=13.02, Base Model=Llama 2-13B2025.07 | 72.7 | |
| AFMModel Size (Billion)=9.63, Base Model=Llama 2-13B2025.07 | 70.9 | |
| IMPACTModel Size (Billion)=8.66, Base Model=Llama 2-13B2025.07 | 70.2 | |
| SVDModel Size (Billion)=9.70, Base Model=Llama 2-13B2025.07 | 69.5 | |
| IMPACTModel Size (Billion)=4.87, Base Model=Llama 2-13B2025.07 | 69.3 | |
| FWSVDModel Size (Billion)=9.24, Base Model=Llama 2-13B2025.07 | 67.9 | |
| AFMModel Size (Billion)=5.33, Base Model=Llama 2-13B2025.07 | 66.4 | |
| AFMModel Size (Billion)=3.81, Base Model=Llama 2-13B2025.07 | 65.7 | |
| IMPACTModel Size (Billion)=3.58, Base Model=Llama 2-13B2025.07 | 65.3 | |
| FWSVDModel Size (Billion)=5.67, Base Model=Llama 2-13B2025.07 | 63.9 | |
| ASVDModel Size (Billion)=7.87, Base Model=Llama 2-13B2025.07 | 63.6 | |
| SVDModel Size (Billion)=6.10, Base Model=Llama 2-13B2025.07 | 63.5 | |
| IMPACTModel Size (Billion)=2.28, Base Model=Llama 2-13B2025.07 | 61.2 | |
| ASVDModel Size (Billion)=6.56, Base Model=Llama 2-13B2025.07 | 61 | |
| AFMModel Size (Billion)=2.59, Base Model=Llama 2-13B2025.07 | 60.8 | |
| ASVDModel Size (Billion)=4.03, Base Model=Llama 2-13B2025.07 | 56.2 | |
| IMPACTModel Size (Billion)=1.49, Base Model=Llama 2-13B2025.07 | 54.8 | |
| FWSVDModel Size (Billion)=2.93, Base Model=Llama 2-13B2025.07 | 51.9 | |
| ASVDModel Size (Billion)=2.73, Base Model=Llama 2-13B2025.07 | 50.6 | |
| SVDModel Size (Billion)=3.27, Base Model=Llama 2-13B2025.07 | 50 | |
| AFMModel Size (Billion)=1.63, Base Model=Llama 2-13B2025.07 | 47.2 | |
| SVDModel Size (Billion)=2.07, Base Model=Llama 2-13B2025.07 | 26.9 | |
| ASVDModel Size (Billion)=1.45, Base Model=Llama 2-13B2025.07 | 25.9 | |
| SVDModel Size (Billion)=1.01, Base Model=Llama 2-13B2025.07 | 6.7 | |
| FWSVDModel Size (Billion)=0.83, Base Model=Llama 2-13B2025.07 | 3.9 | |
| FWSVDModel Size (Billion)=1.79, Base Model=Llama 2-13B2025.07 | 2.4 |