Code Generation on MBPP subsampled 2500 s
82.1AccuracyQwen 7B (Gem)
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen 7B (Gem)Tree=Qwen 7B, Model Category=Hidden Gem2026.01 | 82.1 | |
| Qwen 7B (Base)Tree=Qwen 7B, Model Category=Popular Consensus (Base)2026.01 | 80.9 | |
| Qwen 3B (Gem)Tree=Qwen 3B, Model Category=Hidden Gem2026.01 | 73.3 | |
| Llama 8B (Gem)Tree=Llama 8B, Model Category=Hidden Gem2026.01 | 68.8 | |
| Qwen 3B (Base)Tree=Qwen 3B, Model Category=Popular Consensus (Base)2026.01 | 68.6 | |
| Llama 8B (Base)Tree=Llama 8B, Model Category=Popular Consensus (Base)2026.01 | 65.6 | |
| Mistral 7B (Gem)Tree=Mistral 7B, Model Category=Hidden Gem2026.01 | 58.8 | |
| Mistral 7B (Base)Tree=Mistral 7B, Model Category=Popular Consensus (Base)2026.01 | 47 |