Accuracy (%) on MMLU
52.15AccuracySFT
Evaluation Results
| Method | Links | |
|---|---|---|
| SFTModel=Qwen3-8B-Base2025.07 | 52.15 | |
| SFT+GRPOModel=Qwen3-8B-Base2025.07 | 50.85 | |
| SFT+PenaltyModel=Qwen3-8B-Base2025.07 | 50.74 | |
| SASFTModel=Qwen3-8B-Base2025.07 | 50.09 | |
| SFT+PenaltyModel=Gemma-2-9B2025.07 | 46.39 | |
| SASFTModel=Gemma-2-9B2025.07 | 45.91 | |
| SFTModel=Gemma-2-9B2025.07 | 44.31 | |
| SFT+GRPOModel=Gemma-2-9B2025.07 | 44.21 | |
| SASFTModel=Qwen3-1.7B-Base2025.07 | 38.38 | |
| SFT+GRPOModel=Qwen3-1.7B-Base2025.07 | 37.8 | |
| SFT+PenaltyModel=Qwen3-1.7B-Base2025.07 | 37.78 | |
| SFTModel=Qwen3-1.7B-Base2025.07 | 37.47 | |
| SASFTModel=Llama-3.1-8B2025.07 | 33.12 | |
| SFT+PenaltyModel=Gemma-2-2B2025.07 | 30.81 | |
| SASFTModel=Gemma-2-2B2025.07 | 30.24 | |
| SFTModel=Llama-3.1-8B2025.07 | 29.99 | |
| SFTModel=Gemma-2-2B2025.07 | 29.88 | |
| SFT+PenaltyModel=Llama-3.1-8B2025.07 | 29.7 | |
| SFT+GRPOModel=Llama-3.1-8B2025.07 | 29.67 | |
| SFT+GRPOModel=Gemma-2-2B2025.07 | 29.66 |