Science Question Answering on ScienceQA v1.0 (test) benchmark leaderboard · SOTA2 Research

Science Question Answering on ScienceQA v1.0 (test)

82.5Accuracy (G1-4)AUTOACT

Evaluation Results

Method	Links
AUTOACT2024.01		82.5	72.5	80.83	78.61
Chameleon2024.01		77.83	69.17	76.67	74.56
Zero-Shot Plan*2024.01		76.67	61.67	78.33	72.22
Reflexion2024.01		75.83	67.5	78.33	73.89
CoT2024.01		74.17	64.17	75.83	71.39
FireAct2024.01		72.5	68.33	75	71.94
AUTOACT2024.01		70.83	66.67	76.67	71.39
BOLAA2024.01		70	67.5	75	70.83
AUTOACT2024.01		69.17	68.33	72.5	70
Chameleon2024.01		69.17	60.83	73.33	67.78
Reflexion2024.01		67.5	65.83	69.17	67.5
Reflexion2024.01		67.5	64.17	73.33	68.33
Chameleon2024.01		65.83	62.5	66.67	65
FireAct2024.01		65	62.5	64.17	63.89
ReWOO2024.01		65	61.67	76.67	67.78
BOLAA2024.01		64.17	61.67	65.83	63.89
ReAct2024.01		64.17	60	72.5	65.56
ReAct2024.01		63.33	58.33	62.5	61.39
CoT2024.01		61.67	52.5	69.17	61.11
CoT2024.01		60.83	55.83	65	60.56
ReWOO2024.01		60.83	58.33	64.17	61.11
FireAct2024.01		60.83	57.5	67.5	61.94
BOLAA2024.01		60	54.17	65.83	60
ReAct2024.01		57.5	51.67	65	58.06
ReWOO2024.01		57.5	54.17	65.83	59.17
CoT2024.01		54.17	50	60	54.72