List your company
ResearchFormerly WizWand

Commonsense Question Answering on MCEval CSQA 8K (test)

84.6AccuracyMagn-Probe
53.9261.88569.8577.815Dec 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
Magn-ProbeModel=Llama2-70B2024.1284.6
ActModel=Qwen2.5-7B2024.1281.6
Magn-ProbeModel=Qwen2.5-7B2024.1281.4
LM-ProbModel=Qwen2.5-7B2024.1276.8
LM-ProbModel=Llama2-70B2024.1274.3
Magn-ProbeModel=Llama3.1-8B2024.1274
ActModel=Llama3.1-8B2024.1273.3
Magn-ProbeModel=Llama3.2-3B2024.1269.1
ActModel=Llama3.2-3B2024.1268.1
LM-ProbModel=Llama3.1-8B2024.1267.4
Magn-ProbeModel=Llama2-7B2024.1263.9
ActModel=Llama2-7B2024.1261.3
LM-ProbModel=Llama2-7B2024.1261
LM-ProbModel=Llama3.2-3B2024.1255.1