List your company
ResearchFormerly WizWand

Symbolic Reasoning (Equations) on NoRa Irrelevant Rationales

49.3AccuracyCD-CoT
7.07618.0382939.962Oct 31, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CD-CoTModel=Gemini-Pro2024.1049.3
SCModel=Gemini-Pro2024.1043.3
CD-CoTModel=GPT-3.5-turbo2024.1042.7
BaseModel=Gemini-Pro2024.1038.9
CCModel=Gemini-Pro2024.1037.3
CCModel=GPT-3.5-turbo2024.1032.7
BTModel=Gemini-Pro2024.1029.3
SCModel=GPT-3.5-turbo2024.1028.3
BaseModel=GPT-3.5-turbo2024.1025.1
BTModel=GPT-3.5-turbo2024.1022.7
CD-CoTModel=Mixtral 8x7B2024.1022.7
SCModel=Mixtral 8x7B2024.1021.7
CCModel=Mixtral 8x7B2024.1018.5
BaseModel=Mixtral 8x7B2024.1017.9
CCModel=LLaMA2-70B2024.1016.3
BTModel=LLaMA2-70B2024.1011.2
SCModel=LLaMA2-70B2024.1010.3
CD-CoTModel=LLaMA2-70B2024.109.7
BTModel=Mixtral 8x7B2024.109.7
BaseModel=LLaMA2-70B2024.108.7