Reasoning on OBQA (val)
39.6AccuracyProDiaL
Evaluation Results
| Method | Links | |
|---|---|---|
| ProDiaLProjectors=Both-Proj, Number of Parameters=1.18M2024.11 | 39.6 | |
| DoRAProjectors=Both-Proj, Number of Parameters=1.27M2024.11 | 38.2 | |
| LoRAProjectors=Both-Proj, Number of Parameters=1.18M2024.11 | 38 | |
| ProDiaLProjectors=In-Proj, Number of Parameters=0.89M2024.11 | 37.8 | |
| DoRAProjectors=In-Proj, Number of Parameters=0.81M2024.11 | 36.8 | |
| LoRAProjectors=In-Proj, Number of Parameters=0.74M2024.11 | 36.4 | |
| ProDiaLProjectors=Out-Proj, Number of Parameters=0.46M2024.11 | 35 | |
| DoRAProjectors=Out-Proj, Number of Parameters=0.46M2024.11 | 34.2 | |
| LoRAProjectors=Out-Proj, Number of Parameters=0.44M2024.11 | 33.8 |