List your company
ResearchFormerly WizWand

General LLM Evaluation on Instruction-Following, Mathematics, and Commonsense Reasoning Combined

57Average ScoreQwen2.5 7B-PC
24.7633.1341.549.87May 23, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Qwen2.5 7B-PCBackbone=Qwen2.5 7B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.0557
Granite 3.1 8B-PCBackbone=Granite 3.1 8B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.0556
Olmo 3 7B-PCBackbone=Olmo 3 7B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.0555
Llama 3.1 8B-PCBackbone=Llama 3.1 8B, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.0554
Qwen2.5 7B-NLBackbone=Qwen2.5 7B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.0553
Olmo 3 7B-NLBackbone=Olmo 3 7B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.0550
Mistral 7B v0.3-PCBackbone=Mistral 7B v0.3, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.0548
Qwen2.5 7B-CPBackbone=Qwen2.5 7B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.0547
Llama 3.1 8B-NLBackbone=Llama 3.1 8B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.0545
Granite 8B Code-PCBackbone=Granite 8B Code, Strategy=Pseudo-code tuned, Zero-shot=true, Greedy decoding=true2025.0543
Olmo 3 7B-CPBackbone=Olmo 3 7B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.0539
Granite 3.1 8B-CPBackbone=Granite 3.1 8B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.0537
Granite 8B Code-NLBackbone=Granite 8B Code, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.0536
Mistral 7B v0.3-NLBackbone=Mistral 7B v0.3, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.0535
Llama 3.1 8B-CPBackbone=Llama 3.1 8B, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.0534
Mistral 7B v0.3-CPBackbone=Mistral 7B v0.3, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.0533
Granite 8B Code-CPBackbone=Granite 8B Code, Strategy=Code-Prompted, Zero-shot=true, Greedy decoding=true2025.0529
Granite 3.1 8B-NLBackbone=Granite 3.1 8B, Strategy=NL-tuned, Zero-shot=true, Greedy decoding=true2025.0526