List your company

Code Generation on HumanEval (∆HumanEval (pp))

1.63Delta HumanEval (pp)Aletheia
-0.6996-0.09480.511.1148Apr 4, 2026

Evaluation results

MethodLinks
AletheiaModel=Qwen2.5-3B2026.041.63
AletheiaModel=Llama-3.1-8B2026.041.53
AletheiaModel=StableLM-2-1.6B2026.041.42
AletheiaModel=GPT-J-6B2026.040
AletheiaModel=Mixtral-8×7B2026.040
AletheiaModel=Qwen2.5-7B2026.04-0.61