Single-line fill-in-the-middle on FIM JavaScript (test)
74Line Exact Match RateStarCoder
Evaluation Results
| Method | Links | |
|---|---|---|
| StarCoder2023.05 | 74 | |
| SantaCoder2023.05 | 60 | |
| InCoder-6BParameters=6B2023.05 | 51 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| StarCoder2023.05 | 74 | |
| SantaCoder2023.05 | 60 | |
| InCoder-6BParameters=6B2023.05 | 51 |