List your company
ResearchFormerly WizWand

Paraphrase Identification on MRPC

-4.73Delta 1Qwen2.5-14B
-5.99842.563311.12519.6867Nov 24, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Qwen2.5-14Bscenario=updated dataset (ours)2025.11-4.730.37
Yi1.5-9Bscenario=updated dataset (ours)2025.11-3.50.27
Yi1.5-6Bscenario=updated dataset (ours)2025.11-10.21
Qwen2.5-7Bscenario=updated dataset (ours)2025.110.04-0.39
Mistral-12Bscenario=updated dataset (ours)2025.110.610.43
Llama3-8Bscenario=updated dataset (ours)2025.110.750.53
Qwen2.5-7Bscenario=semantic dataset2025.113.212.32
Ministral-8Bscenario=updated dataset (ours)2025.113.860.32
Qwen2.5-14Bscenario=semantic dataset2025.115.491.42
Llama3-8Bscenario=semantic dataset2025.116.372.78
Yi1.5-9Bscenario=semantic dataset2025.116.481.89
Yi1.5-6Bscenario=semantic dataset2025.116.921.39
Qwen2.5-7Bscenario=original dataset2025.118.064.16
Llama2-13Bscenario=updated dataset (ours)2025.1110.09-0.31
Mistral-12Bscenario=semantic dataset2025.1110.542.28
Llama3-8Bscenario=original dataset2025.1110.987.05
Ministral-8Bscenario=semantic dataset2025.1111.942.84
Yi1.5-6Bscenario=original dataset2025.1114.967.71
Llama2-13Bscenario=semantic dataset2025.1118.442.5
Qwen2.5-14Bscenario=original dataset2025.1119.956.94
Yi1.5-9Bscenario=original dataset2025.1123.8710.41
Ministral-8Bscenario=original dataset2025.1125.648.91
Mistral-12Bscenario=original dataset2025.1126.519.3
Llama2-13Bscenario=original dataset2025.1126.986.83