List your company
ResearchFormerly WizWand

Competitive Programming on LiveCodeBench (Accuracy)

65.65AccuracySMCS
12.8726.572540.27553.9775Jul 14, 2025
Updated 5mo ago

Evaluation results

MethodLinks
SMCSMaximum output tokens=32,7682025.0765.65
Qwen3-32BMaximum output tokens=32,7682025.0764.1
QwQ-32BMaximum output tokens=32,7682025.0759.6
EXAONE-Deep-32BMaximum output tokens=32,7682025.0758.1
DeepSeek-R1-Distill-Qwen-32BMaximum output tokens=32,7682025.0758.1
DeepSeek-R1-Distill-Llama-70BMaximum output tokens=32,7682025.0757.8
GLM-Z1-32B-0414Maximum output tokens=32,7682025.0756.5
GPT-o3-mini(2025-01-31)Maximum output tokens=32,7682025.0754.7
GPT-4.1(2025-04-14)Maximum output tokens=32,7682025.0742.2
Claude-3.7-Sonnet(2025-02-19)Maximum output tokens=32,7682025.0741.3
Claude-3.5-Sonnet(2024-06-20)Maximum output tokens=32,7682025.0734.3
Llama-3.3-70B-InstructMaximum output tokens=32,7682025.0730.1
GPT-4o(2024-08-06)Maximum output tokens=32,7682025.0729.8
Llama-3.3-Nemotron-Super-49B-v1Maximum output tokens=32,7682025.0728
Gemma-3-27b-itMaximum output tokens=32,7682025.0727.7
Qwen2.5-Coder-32B-InstructMaximum output tokens=32,7682025.0727.7
Qwen-2.5-72B-InstructMaximum output tokens=32,7682025.0726.1
HuatuoGPT-o1-72BMaximum output tokens=32,7682025.0724.3
Qwen2.5-32b-InstructMaximum output tokens=32,7682025.0724
TeleChat2-35B-32KMaximum output tokens=32,7682025.0719.5
InternLM2.5-20B-ChatMaximum output tokens=32,7682025.0714.9