List your company
ResearchFormerly WizWand

Instruction Satisfaction on CODI

94.6ISRDVR (coldstart)
67.14474.27281.488.528Oct 16, 2024
Updated 8mo ago

Evaluation results

MethodLinks
DVR (coldstart)Base Model=Llama3.1 8B2024.1094.6
DVR (warmstart)Base Model=Llama3.1 8B2024.1094.6
DVR (warmstart)Base Model=Llama3 8B2024.1094.4
DVR (coldstart)Base Model=Llama3 8B2024.1094.2
DVR (warmstart)Base Model=Mistral 7B2024.1093.2
CRITICBase Model=Llama3 8B2024.1093
DVR (coldstart)Base Model=Mistral 7B2024.1092
CRITICBase Model=Llama3.1 8B2024.1091.2
CRITICBase Model=Mistral 7B2024.1088.6
ReActBase Model=Llama3.1 8B2024.1081.8
Reject SampleBase Model=Llama3.1 8B2024.1081.4
ReActBase Model=Llama3 8B2024.1081
Reject SampleBase Model=Llama3 8B2024.1080.8
ReActBase Model=Mistral 7B2024.1080.4
Reject SampleBase Model=Mistral 7B2024.1079.8
USCBase Model=Llama3 8B2024.1070.2
ReflexionBase Model=Llama3 8B2024.1070
ReflexionBase Model=Llama3.1 8B2024.1069.8
USCBase Model=Llama3.1 8B2024.1069.6
ReflexionBase Model=Mistral 7B2024.1069.4
USCBase Model=Mistral 7B2024.1069.2
VanillaBase Model=Mistral 7B2024.1068.8
VanillaBase Model=Llama3 8B2024.1068.8
VanillaBase Model=Llama3.1 8B2024.1068.6
BSMBase Model=Llama3.1 8B2024.1068.6
BSMBase Model=Llama3 8B2024.1068.4
BSMBase Model=Mistral 7B2024.1068.2