Secret Detection on GitHub Issue Reports (test)
93.05PrecisionStarPII
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| StarPIIBackbone=BigCode2026.02 | 93.05 | 85.5 | 89.11 | |
| IssueGuardBackbone=CodeBERT, Training=fine-tuned2026.02 | 92.49 | 92.91 | 92.7 | |
| RoBERTa-base2026.02 | 91.1 | 89.4 | 90.24 | |
| StarCoderParameters=15B2026.02 | 88.5 | 89.5 | 89 | |
| Regex-only2026.02 | 6.8 | 100 | 12.8 |