Generation on OPT 1.3B Generation
80.4SQuAD ScoreFO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FOBackbone=OPT-1.3B, Memory Constraint=≥ 4× memory2026.05 | 80.4 | 28.2 | 66.2 | |
| AdaMeZOBackbone=OPT-1.3B2026.05 | 76.1 | 24.6 | 63.1 | |
| HiZOOBackbone=OPT-1.3B2026.05 | 74.5 | 24.5 | 61.7 | |
| MeZO-switchBackbone=OPT-1.3B2026.05 | 73.7 | 24.3 | 62.3 | |
| MeZOBackbone=OPT-1.3B2026.05 | 73.3 | 22.8 | 61.4 | |
| Zero-shotBackbone=OPT-1.3B, Evaluation Protocol=Zero-shot2026.05 | 27.2 | 11.1 | 47.4 |