List your company
ResearchFormerly WizWand

Paraphrase Identification on MCEval PAWS 8K (test)

88.9AccuracyAct
48.44458.94769.4579.953Dec 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ActModel=Qwen2.5-7B2024.1288.9
Magn-ProbeModel=Qwen2.5-7B2024.1287.3
ActModel=Llama3.1-8B2024.1286
Magn-ProbeModel=Llama3.1-8B2024.1285.4
ActModel=Llama3.2-3B2024.1284.3
Magn-ProbeModel=Llama3.2-3B2024.1283.1
ActModel=Llama2-7B2024.1282.5
Magn-ProbeModel=Llama2-70B2024.1282.5
Magn-ProbeModel=Llama2-7B2024.1281.5
LM-ProbModel=Llama2-70B2024.1277.9
LM-ProbModel=Qwen2.5-7B2024.1257.4
LM-ProbModel=Llama2-7B2024.1252.4
LM-ProbModel=Llama3.2-3B2024.1250
LM-ProbModel=Llama3.1-8B2024.1250