List your company
ResearchFormerly WizWand

Theory of Mind reasoning on ToMI (All)

87.8Accuracygpt-4
41.93653.84365.7577.657Nov 16, 2023
Updated 8mo ago

Evaluation results

MethodLinks
gpt-4Prompting strategy=SIMTOM2023.1187.8
gpt-4Prompting strategy=0-shot CoT2023.1174.4
gpt-3.5-turboPrompting strategy=SIMTOM2023.1172.8
gpt-3.5-turboPrompting strategy=0-Shot2023.1168.6
gpt-4Prompting strategy=0-Shot2023.1166.5
gpt-3.5-turboPrompting strategy=0-shot CoT2023.1164.1
Llama2-13b-chatPrompting strategy=SIMTOM2023.1161.1
Llama2-13b-chatPrompting strategy=0-Shot2023.1151
Llama2-7b-chatPrompting strategy=SIMTOM2023.1148.1
Llama2-13b-chatPrompting strategy=0-shot CoT2023.1145
Llama2-7b-chatPrompting strategy=0-Shot2023.1144.5
Llama2-7b-chatPrompting strategy=0-shot CoT2023.1143.7