Code Efficiency on Mercury
83.6Beyond@1IQuest-Coder-V1-40B-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IQuest-Coder-V1-40B-InstructModel Size Category=20B+, Type=Instruct2026.03 | 83.6 | 95.3 | |
| Gemini-3-Pro-previewModel Size Category=Closed-APIs, Type=Pro-preview2026.03 | 83.1 | 96.1 | |
| Claude-Opus-4.5Model Size Category=Closed-APIs2026.03 | 82.9 | 96.9 | |
| Claude-Sonnet-4.5Model Size Category=Closed-APIs2026.03 | 82.5 | 97.7 | |
| IQuest-Coder-V1-40B-Loop-InstructModel Size Category=20B+, Type=Loop-Instruct2026.03 | 82.2 | 94.1 | |
| GPT-5.1Model Size Category=Closed-APIs2026.03 | 81.9 | 96.1 | |
| DeepSeek-v3.2Model Size Category=20B+2026.03 | 81.6 | 96.9 | |
| Qwen3-Coder-30B-A3B-InstructModel Size Category=13B+, Type=Instruct2026.03 | 81.1 | 95.3 | |
| Qwen3-235B-A22B-Instruct-2507Model Size Category=20B+, Type=Instruct2026.03 | 80.4 | 96.9 | |
| Qwen3-Coder-480B-A35B-InstructModel Size Category=20B+, Type=Instruct2026.03 | 80.2 | 96.1 | |
| IQuest-Coder-V1-40B-Loop-ThinkingModel Size Category=20B+, Type=Loop-Thinking2026.03 | 79.6 | 94.9 | |
| Qwen2.5-Coder-32B-InstructModel Size Category=20B+, Type=Instruct2026.03 | 79.1 | 96.1 | |
| KAT-Dev-72B-ExpModel Size Category=20B+2026.03 | 79 | 94.5 | |
| Seed-Coder-8B-InstructModel Size Category=6B+, Type=Instruct2026.03 | 78.5 | 93.8 | |
| Gemini-3-Flash-previewModel Size Category=Closed-APIs, Type=Flash-preview2026.03 | 78.4 | 89.5 | |
| DeepSeek-Coder-V2-Lite-InstructModel Size Category=6B+, Type=Instruct2026.03 | 76.8 | 91.4 | |
| Qwen2.5-Coder-14B-InstructModel Size Category=13B+, Type=Instruct2026.03 | 76.7 | 88.3 | |
| Kimi-K2-Instruct-0905Model Size Category=20B+, Type=Instruct2026.03 | 76.1 | 90.6 | |
| KAT-DevModel Size Category=20B+2026.03 | 75.1 | 89.1 | |
| GLM-4.7Model Size Category=20B+2026.03 | 74.1 | 86.7 | |
| Kimi-K2-ThinkingModel Size Category=20B+, Type=Thinking2026.03 | 73 | 85.2 | |
| IQuest-Coder-V1-40B-ThinkingModel Size Category=20B+, Type=Thinking2026.03 | 71.1 | 83.2 | |
| Qwen2.5-Coder-7B-InstructModel Size Category=6B+, Type=Instruct2026.03 | 69.9 | 84.8 | |
| IQuest-Coder-V1-14B-InstructModel Size Category=13B+, Type=Instruct2026.03 | 63.3 | 76.2 | |
| IQuest-Coder-V1-14B-ThinkingModel Size Category=13B+, Type=Thinking2026.03 | 62 | 74.2 | |
| Qwen3-235B-A22B-Thinking-2507Model Size Category=20B+, Type=Thinking2026.03 | 61.2 | 70.3 | |
| Kimi-Dev-72BModel Size Category=20B+2026.03 | 59.1 | 69.5 | |
| IQuest-Coder-V1-7B-ThinkingModel Size Category=6B+, Type=Thinking2026.03 | 43.2 | 53.5 | |
| IQuest-Coder-V1-7B-InstructModel Size Category=6B+, Type=Instruct2026.03 | 42.1 | 50.4 |