List your company
ResearchFormerly WizWand

Counterfactual Reasoning on CRASS

94.53Exact Match PerformanceGPT-4
59.981268.950677.9286.8894Nov 18, 2023
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4Setting=Zero-shot2023.1194.53
Orca-1-13BSetting=Zero-shot2023.1190.15
Orca 2-7BSetting=Zero-shot, System Message=Cautious2023.1188.32
Orca 2-13BSetting=Zero-shot, System Message=Cautious2023.1187.59
Orca 2-13BSetting=Zero-shot, System Message=Default2023.1186.86
WizardLM-70BSetting=Zero-shot2023.1186.13
ChatGPTSetting=Zero-shot2023.1185.77
Orca 2-7BSetting=Zero-shot, System Message=Default2023.1184.31
LLaMA-2-Chat-70BSetting=Zero-shot2023.1174.82
WizardLM-13BSetting=Zero-shot2023.1167.88
LLaMA-2-Chat-13BSetting=Zero-shot2023.1161.31