Diagram Generation on Code Agent benchmark leaderboard · SOTA2 Research

Diagram Generation on Code Agent

58.15Pass@1DiagramAgent

Evaluation Results

Method	Links
DiagramAgent2024.11		58.15	51.97	86.83	74.62	53.49	39.71	11.16	45.95	6.38	24.78
DeepSeek-Coder2024.11		55.56	44.26	83.29	81.85	42.01	30.55	15.49	60.99	6.02	19.8
DeepSeek V2.52024.11		54.44	43	82.83	85.67	43.63	28.75	13.32	62.32	5.56	16.98
GPT-4o2024.11		49.81	44.59	82.83	85.17	43.83	30.08	13.26	63.07	5.56	18.21
Codegeex4-all2024.11		49.63	42.14	82.94	86.31	41.36	28.69	13.86	61.08	5.48	17.37
Gemini2024.11		43.23	44.86	82.37	84.44	43.75	30.46	21.69	54.93	3.16	18.7
GLM-4-plus2024.11		42.96	46.42	83.91	82.4	44.51	32.13	14.7	63.38	4.47	13.89
Qwen22024.11		41.48	41.74	82.49	84.86	39.72	27.93	15.57	58.89	4.6	15.48
Yi-Coder2024.11		37.04	41.38	82.46	83.91	39.2	28	22.4	57.1	3.91	14.11
Yi-1.52024.11		35.19	42.56	82.91	85.52	42.03	28.43	20.03	58.04	3.82	12.83
Internlm2_52024.11		34.44	39.45	81.79	87	38.44	26.21	24.56	56.81	3.91	13.39
Llama-3.12024.11		33.58	37.04	80.45	88.24	36.8	24.79	17.91	58.8	3.78	11.94
Qwen2.5-Coder2024.11		32.22	41.94	82.58	83.45	38.14	28.09	18.9	60.54	3.72	13.04
WizardCoder2024.11		28.89	29.93	78.96	91.3	31.38	19.73	27.38	55.96	3.36	11.66
Starcoder22024.11		27.41	26.49	78.56	90.67	25.98	17.74	31.63	56.54	3.11	10.53
Baichuan22024.11		16.3	33.28	79.94	87.96	31.83	21.51	23.43	61.49	1.81	4.94
Code-Llama2024.11		8.89	22.92	76.78	95.89	28.77	13.6	30.12	59.8	0.89	2.32