Disruption on ACIARENA Code benchmark leaderboard · SOTA2 Research

Disruption on ACIARENA Code

58.67UAMetaGPT + SANDWICH

Evaluation Results

Method	Links
MetaGPT + SANDWICH2026.04		58.67	0
MetaGPT + ACI-SENTINEL2026.04		44.44	7.11
AgentVerse2026.04		35.11	45.78
AgentVerse2026.04		24.89	60.44
AgentVerse + BERT DETECTOR2026.04		23.56	59.78
AgentVerse + DELIMITER2026.04		23.56	63.11
AgentVerse + SANDWICH2026.04		23.56	60.44
AgentVerse + G-SAFEGUARD2026.04		20.89	74.67
AgentVerse + AGRAIL2026.04		20.22	65.33
AgentVerse + ACI-SENTINEL2026.04		16.22	73.78
AutoGen + SANDWICH2026.04		14.22	78.67
Self Consistency2026.04		13.78	76.89
MetaGPT2026.04		8.89	79.56
CAMEL2026.04		8.22	59.11
LLM Debate2026.04		7.89	86.67
AutoGen + ACI-SENTINEL2026.04		6.67	82.89
MetaGPT + G-SAFEGUARD2026.04		6.22	92.89
AutoGen + DELIMITER2026.04		6	96.67
MetaGPT + DELIMITER2026.04		6	81.78
MetaGPT2026.04		5.33	88.89
AutoGen2026.04		4.45	90.89
AutoGen2026.04		4.22	96.44
MetaGPT + BERT DETECTOR2026.04		2.22	86.67
AutoGen + BERT DETECTOR2026.04		2	99.78
AutoGen + AGRAIL2026.04		1.11	96.44
AutoGen + G-SAFEGUARD2026.04		0.22	96.44
MetaGPT + AGRAIL2026.04		0	96.89