List your company
ResearchFormerly WizWand

Dishonesty Evaluation on Mistake medical (test)

67.52Dishonesty AccuracyCONCEPTINF
44.369650.379856.3962.4002May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
CONCEPTINFModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0567.52
ICL-EMModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0565.69
MixedModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0564.96
SAE-FEATModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0564.6
VECFILTERModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0563.87
PROJDIFFModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0562.77
CONCEPTINFModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0558.03
IF-GUIDEModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0556.93
PRISMModel=Llama-3.1-8B-Instruct, Mix ratio=50%2026.0555.84
IF-GUIDEModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0555.47
ICL-EMModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0555.11
VECFILTERModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0554.75
VECFILTERModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0553.65
ICL-EMModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0553.65
PROJDIFFModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0552.92
SAE-FEATModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0552.56
MixedModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0552.19
MixedModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0551.83
PROJDIFFModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0551.83
PROJDIFFModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0551.46
SAE-FEATModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0551.1
IF-GUIDEModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0551.1
CONCEPTINFModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0550
PRISMModel=Llama-3.1-8B-Instruct, Mix ratio=20%2026.0549.27
IF-GUIDEModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0548.54
VECFILTERModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0548.18
CONCEPTINFModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0548.18
ICL-EMModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0548.18
MixedModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0547.81
SAE-FEATModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0547.81
PRISMModel=Llama-3.1-8B-Instruct, Mix ratio=10%2026.0547.45
PRISMModel=Llama-3.1-8B-Instruct, Mix ratio=1%2026.0545.26