Method Body Generation on Java suite (test)
53API Call Set CountNSG
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| NSG2021.10 | 53 | 42 | 39 | 26 | |
| GPTNeo1.3B2021.10 | 37 | 20 | 15 | 15 | |
| CODEX2021.10 | 36 | 16 | 10 | 10 | |
| CODEGPT2021.10 | 36 | 19 | 14 | 14 | |
| GPTNeo125M2021.10 | 32 | 17 | 12 | 12 | |
| CNG2021.10 | 22 | 18 | 17 | 6 | |
| GNN2NAG2021.10 | 3 | 0.3 | 0 | 0 |