Code Retrieval on Adv
48.6MRRSANTA (Hard Negative)
Evaluation results
| Method | Links | |
|---|---|---|
| SANTA (Hard Negative)Evaluation Protocol=Fine-Tuning2023.05 | 48.6 | |
| SANTAEvaluation Protocol=Zero-Shot2023.05 | 48.1 | |
| CodeRetriever (Hard Negative)Evaluation Protocol=Fine-Tuning2023.05 | 45.1 | |
| CodeRetriever (Inbatch)Evaluation Protocol=Fine-Tuning2023.05 | 43 | |
| CodeT5Evaluation Protocol=Fine-Tuning2023.05 | 39.3 | |
| GraphCodeBERTEvaluation Protocol=Fine-Tuning2023.05 | 35.2 | |
| CodeRetrieverEvaluation Protocol=Zero-Shot2023.05 | 34.7 | |
| CodeBERTEvaluation Protocol=Fine-Tuning2023.05 | 27.2 | |
| GraphCodeBERTEvaluation Protocol=Zero-Shot2023.05 | 0.5 |