Code Problem Solving on LiveCodeBench v6
100Success Rate (Easy)MemP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MemPSkill Executor=Qwen3.5-4B2026.06 | 100 | 42.3 | 22.5 | 47.4 | |
| MemPSkill Executor=Qwen3.5-27B2026.06 | 100 | 67.3 | 47.5 | 66.3 | |
| Qwen3.5-4BSkill Executor=Qwen3.5-27B, Mode=offline2026.06 | 100 | 84.6 | 55 | 74.9 | |
| Qwen3.5-4BSkill Executor=Qwen3.5-27B, Mode=online2026.06 | 100 | 91.9 | 64.5 | 81.4 | |
| SkillComposer-4BSkill Executor=Qwen3.5-27B, Mode=online2026.06 | 100 | 94.2 | 66.8 | 83.1 | |
| No SkillSkill Executor=Qwen3.5-27B2026.06 | 99.5 | 90.4 | 62 | 79.7 | |
| SkillComposer-4BSkill Executor=Qwen3.5-27B, Mode=hybrid2026.06 | 99.4 | 93.3 | 67.2 | 82.9 | |
| Qwen3.5-4BSkill Executor=Qwen3.5-27B, Mode=hybrid2026.06 | 99.2 | 90.4 | 64.2 | 80.6 | |
| No SkillSkill Executor=Qwen3.5-4B2026.06 | 99.1 | 67.3 | 26.8 | 56.6 | |
| SkillComposer-4BSkill Executor=Qwen3.5-4B, Mode=hybrid2026.06 | 98.5 | 69.2 | 31.3 | 59 | |
| SkillComposer-4BSkill Executor=Qwen3.5-27B, Mode=offline2026.06 | 98.3 | 89.4 | 59.7 | 78 | |
| Qwen3.5-4BSkill Executor=Qwen3.5-4B, Mode=online2026.06 | 98.1 | 68.9 | 26.5 | 56.7 | |
| SkillComposer-4BSkill Executor=Qwen3.5-4B, Mode=online2026.06 | 98.1 | 72.7 | 29.3 | 59.1 | |
| Qwen3.5-4BSkill Executor=Qwen3.5-4B, Mode=offline2026.06 | 97.7 | 61.5 | 25 | 53.7 | |
| RiVERBackbone=GLM-Z1-9B-04142026.06 | 97.7 | 59 | 17.9 | 49.7 | |
| Raw-GRPOBackbone=Qwen3-8B2026.06 | 96.9 | 58.3 | 17.9 | 49.3 | |
| Instance-NormBackbone=Qwen3-8B2026.06 | 96.9 | 56.4 | 19.2 | 49.3 | |
| RiVERBackbone=Qwen3-8B2026.06 | 96.9 | 60.3 | 21.2 | 51.4 | |
| Raw-BinaryBackbone=GLM-Z1-9B-04142026.06 | 96.9 | 57.1 | 18.3 | 49.1 | |
| Rank-uniformBackbone=GLM-Z1-9B-04142026.06 | 96.9 | 53.9 | 18.3 | 48.2 | |
| Qwen3-8BBackbone=Qwen3-8B2026.06 | 96.3 | 55.6 | 19.7 | 49.2 | |
| RS-GRPOBackbone=Qwen3-8B2026.06 | 96.1 | 59.6 | 20 | 50.5 | |
| Raw-BinaryBackbone=Qwen3-8B2026.06 | 96.1 | 55.1 | 19.6 | 49 | |
| RS-GRPOBackbone=GLM-Z1-9B-04142026.06 | 96.1 | 59 | 17.9 | 49.3 | |
| GLM-Z1-9B-0414Backbone=GLM-Z1-9B-04142026.06 | 95.6 | 53.3 | 16.1 | 46.7 | |
| Qwen3.5-4BSkill Executor=Qwen3.5-4B, Mode=hybrid2026.06 | 95.4 | 64.1 | 29.6 | 56 | |
| SkillComposer-4BSkill Executor=Qwen3.5-4B, Mode=offline2026.06 | 95.4 | 65.4 | 25.8 | 54.7 | |
| Rank-uniformBackbone=Qwen3-8B2026.06 | 95.4 | 59.6 | 17.5 | 49.1 | |
| Raw-GRPOBackbone=GLM-Z1-9B-04142026.06 | 95.3 | 52.6 | 19.6 | 48 | |
| Instance-NormBackbone=GLM-Z1-9B-04142026.06 | 94.6 | 55.1 | 17.1 | 47.4 |