Programming by Example on LLM-PBE Clean
100AccuracyQwen2.5-Coder 14B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-Coder 14BBackend=Ollama2026.07 | 100 | |
| Qwen2.5-Coder 32B CPUBackend=Ollama2026.07 | 100 | |
| Kimi-k2.7-code APITemperature=0, Token cap=512, Request type=stateless2026.07 | 100 | |
| gpt-5.5 APITemperature=0, Token cap=512, Request type=stateless2026.07 | 100 | |
| claude-opus-4-8 APITemperature=0, Token cap=512, Request type=stateless2026.07 | 100 | |
| gemini-3.1-pro-high APITemperature=0, Token cap=512, Request type=stateless2026.07 | 100 | |
| Qwen2.5-Coder 7BBackend=Ollama2026.07 | 95 | |
| GLM-5.2 APITemperature=0, Token cap=512, Request type=stateless2026.07 | 90 | |
| DeepSeek-Coder-V2 16B 8kBackend=Ollama2026.07 | 80 | |
| Qwen3.7-plus APITemperature=0, Token cap=512, Request type=stateless2026.07 | 75 | |
| DeepSeek-Coder-V2 16BBackend=Ollama2026.07 | 65 | |
| Qwen2.5-Coder 1.5BBackend=Ollama2026.07 | 50 |