Sustainability Test on GOVSIM Pollution scenario, default experiment (test) benchmark leaderboard · SOTA2 Research

Sustainability Test on GOVSIM Pollution scenario, default experiment (test)

40Survival RateGPT-4o

Evaluation Results

Method	Links
GPT-4o2024.04		40	9.2	68.84	57.37	90.54	7.57
Qwen-110B2024.04		20	3.6	32.24	26.87	93.66	55.83
GPT-4-turbo2024.04		20	5.8	55.32	46.1	91.2	11.39
Llama-2-7B2024.04		0	1	20	16.67	90.48	71.11
Llama-2-13B2024.04		0	1	20	16.67	77.76	28.57
Llama-2-70B2024.04		0	1	20	16.67	89.6	49.37
Llama-3-8B2024.04		0	1	20	16.67	42.88	14.29
Llama-3-70B2024.04		0	1	20	16.67	91.6	36.26
Mistral-7B2024.04		0	1	20	16.67	73.52	29.01
Mixtral-8x7B2024.04		0	1.2	20.28	16.9	59.19	24.57
Qwen-72B2024.04		0	1	20	16.67	80.72	31.57
Claude-3 Haiku2024.04		0	1	20	16.67	88.16	35.71
Claude-3 Sonnet2024.04		0	1	20	16.67	71.84	28.57
Claude-3 Opus2024.04		0	1	20	16.67	81.44	34.46
GPT-3.52024.04		0	1	20	16.67	90.88	38.1
GPT-42024.04		0	4.6	39.96	33.3	89.07	20.91