Coreference Resolution on WSC (Loss & Accuracy)
0.02LossHIZOO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| HIZOOModel=Qwen2.5-14B2025.10 | 0.02 | 79 | |
| ZO Fine-tunerModel=Qwen2.5-14B2025.10 | 0.02 | 76 | |
| LOZOModel=Qwen2.5-14B2025.10 | 0.04 | 79 | |
| MeZOModel=Qwen2.5-14B2025.10 | 0.18 | 76 | |
| MeZO-AdamUModel=Qwen2.5-14B2025.10 | 0.25 | 75 | |
| ZO Fine-tunerModel=LLaMA-3.2-1B2025.10 | 0.31 | 56 | |
| MeZOModel=LLaMA-3.2-1B2025.10 | 0.35 | 62 | |
| HIZOOModel=LLaMA-3.1-8B2025.10 | 0.36 | 62 | |
| MeZO-AdamModel=LLaMA-3.2-1B2025.10 | 0.42 | 61 | |
| ZO Fine-tunerModel=LLaMA-3.1-8B2025.10 | 0.44 | 62 | |
| LOZOModel=LLaMA-3.2-1B2025.10 | 0.51 | 61 | |
| ZO Fine-tunerModel=OPT-30B2025.10 | 0.51 | 60 | |
| HIZOOModel=OPT-30B2025.10 | 0.53 | 61 | |
| HIZOOModel=LLaMA-3.2-1B2025.10 | 0.55 | 54 | |
| MeZOModel=LLaMA-3.1-8B2025.10 | 0.55 | 63 | |
| MeZOModel=OPT-30B2025.10 | 0.55 | 63 | |
| LOZOModel=OPT-30B2025.10 | 0.58 | 62 | |
| MeZO-AdamUModel=LLaMA-3.1-8B2025.10 | 0.61 | 64 | |
| LOZOModel=LLaMA-3.1-8B2025.10 | 0.61 | 63 | |
| MeZO-AdamUModel=OPT-30B2025.10 | 0.62 | 63 |