List your company
ResearchFormerly WizWand

Code Generation on mHumanEval

0.94Pass@1BanglaCodeAct
0.07680.30090.5250.7491Nov 27, 2025
Updated 8mo ago

Evaluation results

MethodLinks
BanglaCodeActLLM Model=Qwen3-8B2025.110.94
Self-ConsistencyLLM Model=Qwen3-8B2025.110.88
Few-ShotLLM Model=Llama-3.1-8B2025.110.77
BanglaCodeActLLM Model=DeepSeek-Coder-V2-Lite2025.110.738
Few-ShotLLM Model=DeepSeek-Coder-V2-Lite2025.110.73
Zero-ShotLLM Model=DeepSeek-Coder-V2-Lite2025.110.714
Majority VotingLLM Model=Qwen3-8B2025.110.66
Few-ShotLLM Model=Qwen2.5-Coder-7B2025.110.51
Few-ShotLLM Model=Qwen3-8B2025.110.46
Zero-ShotLLM Model=Qwen2.5-Coder-7B2025.110.44
Zero-ShotLLM Model=Llama-3.1-8B2025.110.39
Zero-ShotLLM Model=Qwen3-8B2025.110.36
Zero-ShotLLM Model=TigerLLM-1B-it2025.110.11