List your company
ResearchFormerly WizWand

CUDA Kernel Generation on KernelBench Level 3

24Executions CountMercury-Coder-Small
-0.965.521218.48Feb 12, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Mercury-Coder-SmallType=Code, #Params=-2026.02241210
DICEType=Kernel (CUDA), #Params=8B2026.021684
Qwen3Type=Reasoning, #Params=4B2026.021420
DICEType=Kernel (CUDA), #Params=4B2026.021264
Stable-DiffCoderType=Code, #Params=8B2026.021062
DICEType=Kernel (CUDA), #Params=1.7B2026.021064
Gemini-3-ProType=General, #Params=-2026.02842
cudaLLMType=Reasoning (CUDA), #Params=8B2026.02640
Dream-Coder-v0-InstructType=Code, #Params=7B2026.02600
Trado-InstructType=Code & Math, #Params=8B2026.02640
Claude-Sonnet-4Type=Code, #Params=-2026.02400
Qwen2.5-Coder-InstructType=Code, #Params=7B2026.02400
Qwen3Type=Reasoning (General), #Params=8B2026.02422
SDAR-ChatType=General, #Params=4B2026.02400
Dream-v0-InstructType=General, #Params=7B2026.02222
Phi-4-Mini-ReasoningType=Reasoning, #Params=4B2026.02200
Deepseek-Coder-Instruct-v1.5Type=Code, #Params=7B2026.02000
Seed-Coder-ReasoningType=Code, #Params=8B2026.02000
LLaDA-InstructType=General, #Params=8B2026.02000
LLaDA-1.5Type=General, #Params=8B2026.02000
SDAR-ChatType=General, #Params=8B2026.02000
WeDLMType=General, #Params=8B2026.02000
DiffuCoder-InstructType=Code, #Params=7B2026.02000
Gemma-2-ItType=General, #Params=2B2026.02000
SDAR-ChatType=General, #Params=1.7B2026.02000
Qwen2.5-Coder-InstructType=Code, #Params=1.5B2026.02000
Deepseek-Coder-InstructType=Code, #Params=1.3B2026.02000
Qwen3Type=Reasoning, #Params=1.7B2026.02000
Llama-3.2-InstructType=General, #Params=3B2026.02000
Trado-InstructType=Code & Math, #Params=4B2026.02000
Qwen2.5-Coder-InstructType=Code, #Params=3B2026.02000