Code Generation on ARCADE
16.2Pass@1PaLM 2-S*
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PaLM 2-S*Backbone=PaLM 2-S, Training=Trained with additional code-related tokens2023.05 | 16.2 | 43.6 | |
| PaLM-Coder-540BParameters=540B2023.05 | 7.9 | 33.6 |
Loading the SOTA2 catalog…
| Method | Links | ||
|---|---|---|---|
| PaLM 2-S*Backbone=PaLM 2-S, Training=Trained with additional code-related tokens2023.05 | 16.2 | 43.6 | |
| PaLM-Coder-540BParameters=540B2023.05 | 7.9 | 33.6 |