List your company

Code Generation on HumanEval (Accuracy, Perplexity)

60.4AccuracyMAGS
55.92857.08958.2559.411May 20, 2026

Evaluation results

MethodLinks
MAGSBase Model=Llama-3.1-8B-Instruct2026.0560.41.13
ASBase Model=Llama-3.1-8B-Instruct2026.0559.11.131
CDBase Model=Llama-3.1-8B-Instruct2026.0559.11.152
ITIBase Model=Llama-3.1-8B-Instruct2026.0557.31.136
UnsteeredBase Model=Llama-3.1-8B-Instruct2026.0556.11.121