Multiple-choice scoring on Winogender
0.847AccuracyPaLM 540B
Evaluation Results
| Method | Links | |
|---|---|---|
| PaLM 540BShots=42022.08 | 0.847 | |
| AlexaTM 20BMode=Denoising, Shots=02022.08 | 0.8263 | |
| PaLM 540BShots=12022.08 | 0.794 | |
| PaLM 540BShots=02022.08 | 0.75 | |
| AlexaTM 20BMode=CLM, Shots=02022.08 | 0.7389 | |
| GLaM 1.2TShots=1, Sparsity=sparse2022.08 | 0.717 | |
| PaLM 62BShots=02022.08 | 0.65 |