List your company

Code Generation on HumanEval (Acc, F1, Avg. Tokens (K))

92.68AccuracySUPERVISORAGENT
73.33678.35883.3888.402Oct 30, 2025

Evaluation results

MethodLinks
SUPERVISORAGENTmodule=SMAS, base_agent=Smolagent2025.1092.6892.6831.19
Smolagent2025.1092.0792.0740.91
OWL2025.1090.7490.7431.87
CoT SCshots=3-shot2025.1077.7877.781.42
Vanilla2025.1076.8276.820.28
MetaAgent2025.1074.0874.082.59