Code Generation on LiveCodeBench Pro (2020Q4)
8.7Acceptance Rate (AC)MAS-Algorithm
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MAS-AlgorithmBase Model=Qwen3-Coder-30B-A3B-Instruct, Evaluation Method=MAS-Algorithm2026.05 | 8.7 | 12.22 | 12.04 | 0.07 | 4.97 | |
| Direct AskBase Model=Qwen3-Coder-30B-A3B-Instruct, Evaluation Method=Direct Ask2026.05 | 7.25 | 8.77 | 8.57 | 0.02 | 4.43 |