Reasoning on SIQA (val)
35.47AccuracyProDiaL
Evaluation Results
| Method | Links | |
|---|---|---|
| ProDiaLProjectors=In-Proj, Number of Parameters=1.03M2024.11 | 35.47 | |
| ProDiaLProjectors=Both-Proj, Number of Parameters=2.51M2024.11 | 34.8 | |
| LoRAProjectors=In-Proj, Number of Parameters=1.48M2024.11 | 34.8 | |
| DoRAProjectors=In-Proj, Number of Parameters=1.55M2024.11 | 34.39 | |
| DoRAProjectors=Both-Proj, Number of Parameters=2.45M2024.11 | 34.34 | |
| LoRAProjectors=Both-Proj, Number of Parameters=2.36M2024.11 | 34.14 | |
| ProDiaLProjectors=Out-Proj, Number of Parameters=0.90M2024.11 | 33.93 | |
| DoRAProjectors=Out-Proj, Number of Parameters=0.90M2024.11 | 33.27 | |
| LoRAProjectors=Out-Proj, Number of Parameters=0.89M2024.11 | 33.16 |