Code Generation on FullStackBench
72.3Pass@1Claude-Opus-4.5
Evaluation results
| Method | Links | |
|---|---|---|
| Claude-Opus-4.5Model Category=Closed-APIs2026.03 | 72.3 | |
| IQuest-Coder-V1-40B-InstructModel Scale=20B+2026.03 | 71.4 | |
| GLM-4.7Model Scale=20B+2026.03 | 70.2 | |
| Claude-Sonnet-4.5Model Category=Closed-APIs2026.03 | 69.7 | |
| IQuest-Coder-V1-40B-Loop-InstructModel Scale=20B+2026.03 | 68.3 | |
| Qwen3-Coder-480B-A35B-InstructModel Scale=20B+2026.03 | 66.4 | |
| Deepseek-V3.2Model Scale=20B+2026.03 | 64.9 | |
| GPT-5.1Model Category=Closed-APIs2026.03 | 64.9 | |
| LongCat-Flash Exp-ChatEvaluation Mode=Chat2025.12 | 64.1 | |
| Kimi-K2-Instruct-0905Model Scale=20B+2026.03 | 63.5 | |
| Qwen3-235B-A22B-Instruct-2507Model Scale=20B+2026.03 | 62.7 | |
| DeepSeek V3.2Evaluation Mode=Chat2025.12 | 62.5 | |
| LongCat-Flash ChatEvaluation Mode=Chat2025.12 | 61.8 | |
| GLM 4.6Evaluation Mode=Chat2025.12 | 61 | |
| Qwen3-Coder-30B-A3B-InstructModel Scale=13B+2026.03 | 60.9 | |
| Claude-3.5-Sonnet-20241022Size Category=Closed-APIs2025.12 | 60.7 | |
| IQuest-Coder-V1-40B-Loop-ThinkingModel Scale=20B+2026.03 | 59.5 | |
| GPT-4o-2024-08-06Size Category=Closed-APIs2025.12 | 58.89 | |
| KAT-DevModel Scale=20B+2026.03 | 58.8 | |
| Qwen2.5-Coder-32B-InstructModel Scale=20B+2026.03 | 57.4 | |
| Qwen2.5-Coder-32B-InstructSize Category=32B+ LLMs2025.12 | 56.88 | |
| DS-Coder-V2-InstructSize Category=32B+ LLMs2025.12 | 56.37 | |
| Seed-Coder-8B-InstructModel Scale=6B+2026.03 | 55.8 | |
| Qwen2.5-Coder-14B-InstructSize Category=13B+ LLMs2025.12 | 55.28 | |
| IQuest-Coder-V1-40B-ThinkingModel Scale=20B+2026.03 | 54.8 | |
| UCoder-32BSize Category=32B+ LLMs2025.12 | 53.35 | |
| Qwen2.5-Coder-14B-InstructModel Scale=13B+2026.03 | 53.1 | |
| KAT-Dev-72B-ExpModel Scale=20B+2026.03 | 52.9 | |
| UCoder-14BSize Category=13B+ LLMs2025.12 | 52.52 | |
| UCoder-7BSize Category=6B+ LLMs2025.12 | 51.27 | |
| DeepSeek-Coder-V2-Lite-InstructModel Scale=6B+2026.03 | 49.4 | |
| IQuest-Coder-V1-14B-InstructModel Scale=13B+2026.03 | 48.6 | |
| DS-Coder-33B-InstructSize Category=32B+ LLMs2025.12 | 48.19 | |
| Qwen2.5-Coder-7B-InstructSize Category=6B+ LLMs2025.12 | 47.95 | |
| IQuest-Coder-V1-14B-ThinkingModel Scale=13B+2026.03 | 46.6 | |
| Starcoder2-15B-Instruct-v0.1Size Category=13B+ LLMs2025.12 | 42.68 | |
| Qwen2.5-Coder-7B-InstructModel Scale=6B+2026.03 | 42.2 | |
| OpenCoder-8B-InstructSize Category=6B+ LLMs2025.12 | 41.08 | |
| DS-Coder-6.7B-InstructSize Category=6B+ LLMs2025.12 | 40.16 | |
| IQuest-Coder-V1-7B-InstructModel Scale=6B+2026.03 | 39.7 | |
| Kimi-Dev-72BModel Scale=20B+2026.03 | 38.6 | |
| IQuest-Coder-V1-7B-ThinkingModel Scale=6B+2026.03 | 32.3 | |
| Muon2026.05 | 30.44 | |
| MONA2026.05 | 29.75 | |
| CodeLlama-34B-InstructSize Category=32B+ LLMs2025.12 | 27.56 | |
| CodeLlama-13B-InstructSize Category=13B+ LLMs2025.12 | 27 | |
| AdamW2026.05 | 25.67 | |
| CodeLlama-7B-InstructSize Category=6B+ LLMs2025.12 | 25.4 |