Reading Comprehension on ReCoRD (F1 score)
81.17F1 ScoreMeZO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MeZOModel=OPT-13B2025.11 | 81.17 | — | |
| ConMeZOModel=OPT-13B2025.11 | 80.87 | — | |
| MeZOModel=OPT-1.3B2025.11 | 70.67 | — | |
| ConMeZOModel=OPT-1.3B2025.11 | 70.67 | — | |
| SSAArchitecture=Nemotron-style decoder, Parameters=114M, Training steps=22K, Training dataset=FineWeb, Zero-shot=true2025.08 | 24.82 | 24.27 | |
| SoftmaxArchitecture=Nemotron-style decoder, Parameters=114M, Training steps=22K, Training dataset=FineWeb, Zero-shot=true2025.08 | 19.83 | 19.32 |