List your company

Diagram Editing on DiagramGenBenchmark 1.0 (test)

98Pass@1DiagramAgent Code Agent
21.0441.026180.98Nov 18, 2024

Evaluation results

MethodLinks
DiagramAgent Code AgentSize=7B2024.119898.4199.933.5897.9697.051.0840.6413.1897
DeepSeek V2.5Size=N/A2024.119596.7798.835.0496.194.961.6343.1612.8191.97
GPT-4oSize=N/A2024.1192.4296.2297.737.3195.4994.51.8943.5314.2388.43
GLM-4-plusSize=N/A2024.119297.0598.636.0696.0495.121.5445.7913.8988.31
DeepSeek-Coder-InstructSize=33B2024.1190.596.6498.485.895.7394.682.6346.2515.8486.42
Yi-1.5-34B-chatSize=34B2024.1190.596.6498.386.8595.7894.522.1345.8616.0685.7
Codegeex4-allSize=9B2024.119096.7398.715.3995.9995.691.9343.4311.4792.35
WizardCoderSize=15B2024.1187.574.5995.228.9184.2363.714.9244.1824.2482.88
Code-LlamaSize=34B2024.118752.5192.5550.9665.8340.224.9544.6224.182.42
Yi-CoderSize=9B2024.1181.596.0398.08795.4393.412.6845.2813.0578.59
Qwen2-7B-InstructSize=7B2024.1181.591.5196.417.8791.3487.633.7244.8715.5976.67
GeminiSize=N/A2024.117295.0995.34793.3293.452.0847.5712.585.59
Qwen2.5-Coder-7BSize=7B2024.1171.591.8697.4213.2689.9186.994.7946.4511.1666.76
Internlm2_5-20b-chatSize=20B2024.115784.3195.5721.1387.9877.96.5843.8512.1455.96
Starcoder2Size=15B2024.114121.3490.2880.7934.0414.369.4444.7611.537.93
Baichuan2-13B-ChatSize=13B2024.1139.582.0792.5130.682.3375.1610.0444.86.537.06
Llama-3.1-8B-InstructSize=8B2024.112450.8589.255.8657.0344.5214.0648.594.0921.37