Bug Identification on Bounce Body Student Programs
93.4AccuracyContrastive HoareLSTM + PTW
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Contrastive HoareLSTM + PTWsampling_agent=pre-trained play-to-win (PTW)2021.10 | 93.4 | 88.6 | 99.6 | 99.5 | 87.2 | |
| Code-as-text2021.10 | 74.2 | 84.6 | 59.2 | 68.6 | 89.2 | |
| Majority Class2021.10 | 50 | — | — | — | — |