List your company
ResearchFormerly WizWand

Reasoning on MA

98.7AccuracyStrategyLLM
68.12476.0628491.938Nov 15, 2023
Updated 8mo ago

Evaluation results

MethodLinks
StrategyLLMModel=GPT-42023.1198.7
StrategyLLM-SCModel=GPT-42023.1198.7
SolutionLLMModel=GPT-42023.1196.7
CoT-SCModel=GPT-42023.1194.7
CoTModel=GPT-42023.1192.7
StrategyLLM-SCModel=Claude-3-Sonnet2023.1188
StrategyLLMModel=Claude-3-Sonnet2023.1183.3
CoT-SCModel=Claude-3-Sonnet2023.1176.7
CoTModel=Claude-3-Sonnet2023.1172.7
SolutionLLMModel=Claude-3-Sonnet2023.1169.3