List your company
ResearchFormerly WizWand

Reasoning on OBQA (val)

39.6AccuracyProDiaL
33.56835.13436.738.266Nov 21, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ProDiaLProjectors=Both-Proj, Number of Parameters=1.18M2024.1139.6
DoRAProjectors=Both-Proj, Number of Parameters=1.27M2024.1138.2
LoRAProjectors=Both-Proj, Number of Parameters=1.18M2024.1138
ProDiaLProjectors=In-Proj, Number of Parameters=0.89M2024.1137.8
DoRAProjectors=In-Proj, Number of Parameters=0.81M2024.1136.8
LoRAProjectors=In-Proj, Number of Parameters=0.74M2024.1136.4
ProDiaLProjectors=Out-Proj, Number of Parameters=0.46M2024.1135
DoRAProjectors=Out-Proj, Number of Parameters=0.46M2024.1134.2
LoRAProjectors=Out-Proj, Number of Parameters=0.44M2024.1133.8