List your company
ResearchFormerly WizWand

Mathematical Reasoning on CP

54AccuracyStrategyLLM-SC
14.4824.743545.26Nov 15, 2023
Updated 8mo ago

Evaluation results

MethodLinks
StrategyLLM-SCBackbone=Meta-Llama-3-70B-Instruct2023.1154
SolutionLLMBackbone=Meta-Llama-3-70B-Instruct2023.1151.5
StrategyLLMBackbone=Meta-Llama-3-70B-Instruct2023.1151.5
CoTBackbone=Meta-Llama-3-70B-Instruct2023.1148.5
StrategyLLM-SCBackbone=Mixtral-8x22B-Instruct-v0.12023.1147.5
CoT-SCBackbone=Meta-Llama-3-70B-Instruct2023.1147
SolutionLLMBackbone=Mixtral-8x22B-Instruct-v0.12023.1144.5
StrategyLLMBackbone=Mixtral-8x22B-Instruct-v0.12023.1144.5
CoTBackbone=Mixtral-8x22B-Instruct-v0.12023.1141
CoT-SCBackbone=Mixtral-8x22B-Instruct-v0.12023.1140.5
StrategyLLM-SCBackbone=Mixtral-8x7B-Instruct-v0.12023.1132
StrategyLLMBackbone=Mixtral-8x7B-Instruct-v0.12023.1128.5
CoT-SCBackbone=Mixtral-8x7B-Instruct-v0.12023.1126.5
StrategyLLM-SCBackbone=Meta-Llama-3-8B-Instruct2023.1125
StrategyLLMBackbone=Meta-Llama-3-8B-Instruct2023.1124.5
CoTBackbone=Mixtral-8x7B-Instruct-v0.12023.1124.5
SolutionLLMBackbone=Mixtral-8x7B-Instruct-v0.12023.1122.5
SolutionLLMBackbone=Meta-Llama-3-8B-Instruct2023.1120.5
CoT-SCBackbone=Meta-Llama-3-8B-Instruct2023.1119.5
CoTBackbone=Meta-Llama-3-8B-Instruct2023.1116