Competitive Programming on AtCoder/LeetCode contest problems 40 (released after 2024-08-01)
67Pass RateAlgoSkill
Evaluation results
| Method | Links | |
|---|---|---|
| AlgoSkillBackbone=Llama 4 Scout, Cutoff=≈2024-11, Seen?=✓2026.06 | 67 | |
| AlgoSkillBackbone=Qwen 3 32B, Cutoff=≈2025-01, Seen?=✓2026.06 | 65 | |
| CoTBackbone=Qwen 3 32B, Cutoff=≈2025-01, Seen?=✓2026.06 | 60 | |
| AlgoSkillBackbone=Claude Haiku 4, Cutoff=≈2025-01, Seen?=✓2026.06 | 57 | |
| CoTBackbone=Llama 4 Scout, Cutoff=≈2024-11, Seen?=✓2026.06 | 55 | |
| AlgoSkill-GBackbone=Qwen 3 32B, Cutoff=≈2025-01, Seen?=✓2026.06 | 52 | |
| CoTBackbone=Claude Haiku 4, Cutoff=≈2025-01, Seen?=✓2026.06 | 52 | |
| DirectBackbone=Llama 4 Scout, Cutoff=≈2024-11, Seen?=✓2026.06 | 50 | |
| DirectBackbone=Qwen 3 32B, Cutoff=≈2025-01, Seen?=✓2026.06 | 47 | |
| DirectBackbone=Claude Haiku 4, Cutoff=≈2025-01, Seen?=✓2026.06 | 47 | |
| AlgoSkill-GBackbone=Claude Haiku 4, Cutoff=≈2025-01, Seen?=✓2026.06 | 47 | |
| AlgoSkill-GBackbone=Llama 4 Scout, Cutoff=≈2024-11, Seen?=✓2026.06 | 45 | |
| AlgoSkillBackbone=Llama 3.1 8B, Cutoff=≈2023-12, Seen?=✗2026.06 | 27 | |
| DirectBackbone=Llama 3.1 8B, Cutoff=≈2023-12, Seen?=✗2026.06 | 22 | |
| CoTBackbone=Llama 3.1 8B, Cutoff=≈2023-12, Seen?=✗2026.06 | 17 | |
| AlgoSkill-GBackbone=Llama 3.1 8B, Cutoff=≈2023-12, Seen?=✗2026.06 | 17 |