List your company

Natural Language Understanding on SuperGLUE 1,000 examples

84BoolQ AccuracyLoRA
5864.7571.578.25Feb 24, 2024

Evaluation results

MethodLinks
LoRAModel=LLaMA2-7b2024.028483.268.89683
S-MeZOModel=LLaMA2-7b2024.0282.277.665.394.880
MeZO-LoRAModel=LLaMA2-7b2024.0280.376.5639478.5
AdaZetaModel=LLaMA2-7b2024.0279.875.8629477.9
ZO-SGD-AdamModel=LLaMA2-7b2024.0278.973.662.193.877.1
MeZOModel=LLaMA2-7b2024.0278.870.262.29476.3
ZO-AdaMUModel=LLaMA2-7b2024.0278.276.56393.677.8
ZO-SGD-ConsModel=LLaMA2-7b2024.0277.168.6639475.7
R-MeZOModel=LLaMA2-7b2024.0276.77461.494.276.6
S-MeZOModel=OPT-13b, Description=Sparse MeZO2024.0273.877.663.7——
R-MeZOModel=OPT-13b, Description=MeZO with Random Mask2024.0272.375.261.7——
MeZOModel=OPT-13b2024.0272.175.562.2——
ZO-SGD-SignModel=LLaMA2-7b2024.0268.26155.682.866.9
ICLModel=OPT-13b, Full Name=In-Context Learning2024.0266.962.150.5——
Zero ShotModel=OPT-13b2024.025959.655——