General LLM Evaluation on Instruction-Following, Mathematics, and Commonsense Reasoning Combined
57Average ScoreQwen2.5 7B-PC
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5 7B-PCBackbone=Qwen2.5 7B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.05 | 57 | |
| Granite 3.1 8B-PCBackbone=Granite 3.1 8B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.05 | 56 | |
| Olmo 3 7B-PCBackbone=Olmo 3 7B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.05 | 55 | |
| Llama 3.1 8B-PCBackbone=Llama 3.1 8B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.05 | 54 | |
| Qwen2.5 7B-NLBackbone=Qwen2.5 7B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.05 | 53 | |
| Olmo 3 7B-NLBackbone=Olmo 3 7B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.05 | 50 | |
| Mistral 7B v0.3-PCBackbone=Mistral 7B v0.3, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.05 | 48 | |
| Qwen2.5 7B-CPBackbone=Qwen2.5 7B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.05 | 47 | |
| Llama 3.1 8B-NLBackbone=Llama 3.1 8B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.05 | 45 | |
| Granite 8B Code-PCBackbone=Granite 8B Code, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.05 | 43 | |
| Olmo 3 7B-CPBackbone=Olmo 3 7B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.05 | 39 | |
| Granite 3.1 8B-CPBackbone=Granite 3.1 8B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.05 | 37 | |
| Granite 8B Code-NLBackbone=Granite 8B Code, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.05 | 36 | |
| Mistral 7B v0.3-NLBackbone=Mistral 7B v0.3, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.05 | 35 | |
| Llama 3.1 8B-CPBackbone=Llama 3.1 8B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.05 | 34 | |
| Mistral 7B v0.3-CPBackbone=Mistral 7B v0.3, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.05 | 33 | |
| Granite 8B Code-CPBackbone=Granite 8B Code, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.05 | 29 | |
| Granite 3.1 8B-NLBackbone=Granite 3.1 8B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.05 | 26 |