List your company
ResearchFormerly WizWand

Code Generation on MBPP (Pass@1, Average)

86.95Pass@1DAAO
67.24272.358577.47582.5915Sep 14, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DAAOLLM=LLM Pool2025.0986.9583.26
MasRouterLLM=LLM Pool2025.098480.66
MaASLLM=gemini-1.5-flash2025.0982.6980.18
MaASLLM=gpt-4o-mini2025.0982.1780.43
AFlowLLM=gpt-4o-mini2025.0981.6779.73
AFlowLLM=gemini-1.5-flash2025.097677.29
ComplexCoTLLM=gpt-4o-mini2025.0975.875.57
VanillaLLM=qwen-2-72b2025.0973.970.05
PromptLLMLLM=LLM Pool2025.0973.675.86
VanillaLLM=gemini-1.5-flash2025.097374.08
CoTLLM=gemini-1.5-flash2025.097374.04
SC(CoT)LLM=gpt-4o-mini2025.097375.42
RouteLLMLLM=LLM Pool2025.0972.675.5
VanillaLLM=gpt-4o-mini2025.0972.273.89
SC(CoT)LLM=gemini-1.5-flash2025.097274.13
ComplexCoTLLM=gemini-1.5-flash2025.0971.873.39
CoTLLM=gpt-4o-mini2025.0969.673.64
VanillaLLM=llama-3.1-70b2025.0968.272.01
ADASLLM=gpt-4o-mini2025.0968.1372.23
ADASLLM=gemini-1.5-flash2025.096872.05