Mathematical Reasoning on GSM8K (Avg. & Avg.Q Metrics)
58.76GSM8K AccuracyRAISE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RAISEBackbone=Llama-3.1-8B, DATA=5%2025.04 | 58.76 | 62.76 | 29.55 | |
| LESSBackbone=Llama-3.1-8B, DATA=5%2025.04 | 55.95 | 62.04 | 12.99 | |
| Full DataBackbone=Llama-3.1-8B, DATA=100%2025.04 | 54.66 | 61.48 | 0 | |
| DEITABackbone=Llama-3.1-8B, DATA=5%2025.04 | 52.99 | 60.69 | -18.13 | |
| IFDBackbone=Llama-3.1-8B, DATA=5%2025.04 | 51.79 | 59.51 | -45.1 | |
| RANDBackbone=Llama-3.1-8B, DATA=5%2025.04 | 49.71 | 59.87 | -36.97 | |
| RAISEBackbone=Llama-3.1-8B, DATA=1%2025.04 | 48.56 | 59.69 | -40.99 | |
| LESSBackbone=Llama-3.1-8B, DATA=1%2025.04 | 47.84 | 59.23 | -51.49 | |
| AlpaGasusBackbone=Llama-3.1-8B, DATA=5%2025.04 | 46.55 | 59.82 | -38.06 | |
| RANDBackbone=Llama-3.1-8B, DATA=1%2025.04 | 44.58 | 58.3 | -72.84 | |
| AlpaGasusBackbone=Llama-3.1-8B, DATA=1%2025.04 | 44.58 | 58.34 | -71.92 | |
| IFDBackbone=Llama-3.1-8B, DATA=1%2025.04 | 44.03 | 57.49 | -91.42 | |
| DEITABackbone=Llama-3.1-8B, DATA=1%2025.04 | 43.75 | 57.98 | -80.25 | |
| Zero-Shot BaselineBackbone=Llama-3.1-8B, DATA=0%2025.04 | 42.61 | 57.12 | -100 |