Natural Language Understanding on NLU tasks 21 benchmarks
0.747Avg NLU ScorePaLM
Evaluation results
| Method | Links | |
|---|---|---|
| PaLMNumber of Parameters=540B, evaluation_mode=1-shot2022.04 | 0.747 | |
| GLaMNumber of Parameters=64B/64E, evaluation_mode=1-shot2022.04 | 0.687 | |
| PaLMNumber of Parameters=62B, evaluation_mode=1-shot2022.04 | 0.673 | |
| GPT-3Number of Parameters=175B, evaluation_mode=1-shot2022.04 | 0.654 | |
| PaLMNumber of Parameters=8B, evaluation_mode=1-shot2022.04 | 0.592 |