Arithmetic Reasoning on MATH
71AccuracyLLM-PeerReview-W
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LLM-PeerReview-WType=LLM Ensemble2025.12 | 71 | 67.8 | — | |
| LLM-PeerReviewType=LLM Ensemble2025.12 | 69.5 | 67.4 | — | |
| Qwen2.5-7B-InstructType=Single LLM2025.12 | 69.3 | 62.7 | — | |
| Llama-3.1-8B-SelectionType=Our variants2025.12 | 68.8 | 66.4 | — | |
| Mistral-7B-SelectionType=Our variants2025.12 | 66.4 | 64.7 | — | |
| Qwen2.5-7B-SelectionType=Our variants2025.12 | 66.2 | 65.5 | — | |
| Smoothie-LocalType=LLM Ensemble2025.12 | 61.8 | 59.8 | — | |
| Qwen2-7B-SelectionType=Our variants2025.12 | 61.7 | 62.1 | — | |
| Agent-ForestType=LLM Ensemble2025.12 | 61 | 60.1 | — | |
| Qwen2-7B-InstructType=Single LLM2025.12 | 59.8 | 56.6 | — | |
| Smoothie-GlobalType=LLM Ensemble2025.12 | 59.8 | 60.5 | — | |
| GaCType=LLM Ensemble2025.12 | 54 | 60.2 | — | |
| Llama-3.1-8B-InstructType=Single LLM2025.12 | 52.3 | 53.5 | — | |
| RandomType=LLM Ensemble2025.12 | 52.2 | 54.2 | — | |
| Theoretical averageType=Single LLM2025.12 | 51.9 | 54.1 | — | |
| HiRABackbone Model=Gemma-2-9B, #Params=108.04M2025.09 | 38.93 | — | — | |
| ABBABackbone Model=Gemma-2-9B, #Params=108.04M2025.09 | 38.5 | — | — | |
| BoHABackbone Model=Gemma-2-9B, #Params=108.04M2025.09 | 38.44 | — | — | |
| FFTBackbone Model=Gemma-2-9B, #Params=9.24B2025.09 | 38.02 | — | — | |
| DoRABackbone Model=Gemma-2-9B, #Params=109.89M2025.09 | 37.76 | — | — | |
| PiSSABackbone Model=Gemma-2-9B, #Params=108.04M2025.09 | 37.04 | — | — | |
| rsLoRABackbone Model=Gemma-2-9B, #Params=108.04M2025.09 | 36.88 | — | — | |
| LoRABackbone Model=Gemma-2-9B, #Params=108.04M2025.09 | 34.68 | — | — | |
| Mistral-7B-InstructType=Single LLM2025.12 | 26.5 | 43.5 | — | |
| DiaBlor/N=N = 32, #Params=2.09%, Base Model=Llama2-7B, Evaluation Protocol=Fine-tuning2025.06 | 20.4 | — | — | |
| Full FTr/N=N/A, #Params=100%, Base Model=Llama2-7B, Evaluation Protocol=Fine-tuning2025.06 | 19.8 | — | — | |
| BoHABackbone Model=Mistral-7B, #Params=83.89M2025.09 | 17.97 | — | — | |
| ABBABackbone Model=Mistral-7B, #Params=83.89M2025.09 | 17.96 | — | — | |
| DoRABackbone Model=Mistral-7B, #Params=85.26M2025.09 | 17.9 | — | — | |
| MiLoRAr/N=r = 64, #Params=1.67%, Base Model=Llama2-7B, Evaluation Protocol=Fine-tuning2025.06 | 17.8 | — | — | |
| FFTBackbone Model=Mistral-7B, #Params=7.24B2025.09 | 17.65 | — | — | |
| DiaBlor/N=N = 64, #Params=1.04%, Base Model=Llama2-7B, Evaluation Protocol=Fine-tuning2025.06 | 17.6 | — | — | |
| HiRABackbone Model=Mistral-7B, #Params=83.89M2025.09 | 17.31 | — | — | |
| LoRAr/N=r = 64, #Params=1.67%, Base Model=Llama2-7B, Evaluation Protocol=Fine-tuning2025.06 | 16.9 | — | — | |
| PiSSABackbone Model=Mistral-7B, #Params=83.88M2025.09 | 16.52 | — | — | |
| rsLoRABackbone Model=Mistral-7B, #Params=83.88M2025.09 | 16.24 | — | — | |
| PiSSAr/N=r = 64, #Params=1.67%, Base Model=Llama2-7B, Evaluation Protocol=Fine-tuning2025.06 | 15.8 | — | — | |
| LoRABackbone Model=Mistral-7B, #Params=83.89M2025.09 | 15.28 | — | — | |
| Zero-shotr/N=N/A, #Params=0%, Base Model=Llama2-7B, Evaluation Protocol=Zero-shot2025.06 | 0 | — | — | |
| ABBABackbone=Mistral-7B, #Params=83.89M2025.09 | — | — | 18.16 | |
| ABBABackbone=Gemma-2-9B, #Params=108.04M2025.09 | — | — | 38.82 | |
| BoHABackbone=Mistral-7B, #Params=83.89M2025.09 | — | — | 19.98 | |
| BoHABackbone=Gemma-2-9B, #Params=108.04M2025.09 | — | — | 38.58 | |
| FFTBackbone=Mistral-7B, #Params=7.24B2025.09 | — | — | 18.34 | |
| FFTBackbone=Gemma-2-9B, #Params=9.24B2025.09 | — | — | 39.44 | |
| HiRABackbone=Mistral-7B, #Params=83.89M2025.09 | — | — | 18.76 | |
| HiRABackbone=Gemma-2-9B, #Params=108.04M2025.09 | — | — | 40.02 | |
| LoRABackbone=Mistral-7B, #Params=83.89M2025.09 | — | — | 16.92 | |
| LoRABackbone=Gemma-2-9B, #Params=108.04M2025.09 | — | — | 34.84 |