List your company
ResearchFormerly WizWand

Symbolic Reasoning (Equations) on NoRa Inaccurate Rationales

53.3AccuracyCD-CoT
7.33219.26631.243.134Oct 31, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CD-CoTModel=Gemini-Pro2024.1053.3
SCModel=Gemini-Pro2024.1045
CD-CoTModel=GPT-3.5-turbo2024.1041.3
BaseModel=Gemini-Pro2024.1036.7
CCModel=Gemini-Pro2024.1035
CCModel=GPT-3.5-turbo2024.1033
SCModel=GPT-3.5-turbo2024.1030.7
BTModel=Gemini-Pro2024.1028.7
BaseModel=GPT-3.5-turbo2024.1026.1
BTModel=GPT-3.5-turbo2024.1022.7
CD-CoTModel=Mixtral 8x7B2024.1021.3
CCModel=Mixtral 8x7B2024.1018.3
SCModel=Mixtral 8x7B2024.1018
BaseModel=Mixtral 8x7B2024.1015.1
CCModel=LLaMA2-70B2024.1014
BTModel=LLaMA2-70B2024.1012.5
BTModel=Mixtral 8x7B2024.1010.1
SCModel=LLaMA2-70B2024.109.7
CD-CoTModel=LLaMA2-70B2024.109.7
BaseModel=LLaMA2-70B2024.109.1