List your company
ResearchFormerly WizWand

Question Answering on BoolQ (Loss and Accuracy)

0.23LossMeZO
0.21120.33810.4650.5919Oct 1, 2025
Updated 5mo ago

Evaluation results

MethodLinks
MeZOModel=Qwen2.5-14B2025.100.2384
HIZOOModel=Qwen2.5-14B2025.100.2586
ZO Fine-tunerModel=Qwen2.5-14B2025.100.2989
LOZOModel=Qwen2.5-14B2025.100.3286
ZO Fine-tunerModel=LLaMA-3.1-8B2025.100.3487
MeZO-AdamUModel=Qwen2.5-14B2025.100.3584
HIZOOModel=LLaMA-3.1-8B2025.100.3679
LOZOModel=LLaMA-3.1-8B2025.100.4183
MeZOModel=LLaMA-3.1-8B2025.100.4278
MeZO-AdamUModel=LLaMA-3.1-8B2025.100.575
ZO Fine-tunerModel=LLaMA-3.2-1B2025.100.5866
MeZOModel=OPT-30B2025.100.666
ZO Fine-tunerModel=OPT-30B2025.100.6167
HIZOOModel=LLaMA-3.2-1B2025.100.6261
LOZOModel=LLaMA-3.2-1B2025.100.6264
MeZO-AdamUModel=OPT-30B2025.100.6266
HIZOOModel=OPT-30B2025.100.6265
MeZOModel=LLaMA-3.2-1B2025.100.6363
MeZO-AdamModel=LLaMA-3.2-1B2025.100.6662
LOZOModel=OPT-30B2025.100.766