List your company
ResearchFormerly WizWand

Reasoning on SIQA (val)

35.47AccuracyProDiaL
33.067633.691334.31534.9387Nov 21, 2024
Updated 8mo ago

Evaluation results

MethodLinks
ProDiaLProjectors=In-Proj, Number of Parameters=1.03M2024.1135.47
ProDiaLProjectors=Both-Proj, Number of Parameters=2.51M2024.1134.8
LoRAProjectors=In-Proj, Number of Parameters=1.48M2024.1134.8
DoRAProjectors=In-Proj, Number of Parameters=1.55M2024.1134.39
DoRAProjectors=Both-Proj, Number of Parameters=2.45M2024.1134.34
LoRAProjectors=Both-Proj, Number of Parameters=2.36M2024.1134.14
ProDiaLProjectors=Out-Proj, Number of Parameters=0.90M2024.1133.93
DoRAProjectors=Out-Proj, Number of Parameters=0.90M2024.1133.27
LoRAProjectors=Out-Proj, Number of Parameters=0.89M2024.1133.16