List your company
ResearchFormerly WizWand

Coreference Resolution on WSC (Loss & Accuracy)

0.02LossHIZOO
-0.0040.1580.320.482Oct 1, 2025
Updated 5mo ago

Evaluation results

MethodLinks
HIZOOModel=Qwen2.5-14B2025.100.0279
ZO Fine-tunerModel=Qwen2.5-14B2025.100.0276
LOZOModel=Qwen2.5-14B2025.100.0479
MeZOModel=Qwen2.5-14B2025.100.1876
MeZO-AdamUModel=Qwen2.5-14B2025.100.2575
ZO Fine-tunerModel=LLaMA-3.2-1B2025.100.3156
MeZOModel=LLaMA-3.2-1B2025.100.3562
HIZOOModel=LLaMA-3.1-8B2025.100.3662
MeZO-AdamModel=LLaMA-3.2-1B2025.100.4261
ZO Fine-tunerModel=LLaMA-3.1-8B2025.100.4462
LOZOModel=LLaMA-3.2-1B2025.100.5161
ZO Fine-tunerModel=OPT-30B2025.100.5160
HIZOOModel=OPT-30B2025.100.5361
HIZOOModel=LLaMA-3.2-1B2025.100.5554
MeZOModel=LLaMA-3.1-8B2025.100.5563
MeZOModel=OPT-30B2025.100.5563
LOZOModel=OPT-30B2025.100.5862
MeZO-AdamUModel=LLaMA-3.1-8B2025.100.6164
LOZOModel=LLaMA-3.1-8B2025.100.6163
MeZO-AdamUModel=OPT-30B2025.100.6263