Code Search on Python (test)
49.4Recall@1COSHC-GraphCodeBERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COSHC-GraphCodeBERTRecall Strategy=ideal classification2022.03 | 49.4 | 74.1 | 80.3 | |
| GraphCodeBERTRecall Strategy=Original2022.03 | 48.5 | 72.6 | 79.2 | |
| COSHC-GraphCodeBERTRecall Strategy=Full Classification Prediction2022.03 | 48.3 | 71.9 | 78.2 | |
| COSHC-GraphCodeBERTRecall Strategy=w/o classification2022.03 | 48.1 | 71.3 | 77.4 | |
| COSHC-CodeBERTRecall Strategy=ideal classification2022.03 | 46 | 70.3 | 77.5 | |
| COSHC-GraphCodeBERTRecall Strategy=one classification2022.03 | 45.9 | 65.3 | 69.8 | |
| CodeBERTRecall Strategy=Original2022.03 | 45.1 | 68.3 | 75.9 | |
| COSHC-CodeBERTRecall Strategy=Full Classification Prediction2022.03 | 45.1 | 67.9 | 75 | |
| COSHC-CodeBERTRecall Strategy=w/o classification2022.03 | 44.9 | 67.3 | 74.2 | |
| COSHC-CodeBERTRecall Strategy=one classification2022.03 | 42.5 | 61.3 | 66.5 | |
| COSHC-CodeBERTaRecall Strategy=ideal classification2022.03 | 13.5 | 27.6 | 34.6 | |
| CodeBERTaRecall Strategy=Original2022.03 | 12.4 | 25 | 31.4 | |
| COSHC-RNNRecall Strategy=ideal classification2022.03 | 12.3 | 28.9 | 38.5 | |
| COSHC-CodeBERTaRecall Strategy=Full Classification Prediction2022.03 | 12.3 | 24.7 | 30.9 | |
| COSHC-CodeBERTaRecall Strategy=w/o classification2022.03 | 12.2 | 24.2 | 30.2 | |
| COSHC-CodeBERTaRecall Strategy=one classification2022.03 | 11.6 | 22.1 | 27.1 | |
| COSHC-RNNRecall Strategy=Full Classification Prediction2022.03 | 11.2 | 25.9 | 34.3 | |
| COSHC-RNNRecall Strategy=w/o classification2022.03 | 11.2 | 25.4 | 33.5 | |
| COSHC-RNNRecall Strategy=one classification2022.03 | 11.2 | 24.3 | 31.1 | |
| RNNRecall Strategy=Original2022.03 | 11.1 | 25.3 | 33.3 | |
| COSHC-UNIFRecall Strategy=ideal classification2022.03 | 7.7 | 20.2 | 27.7 | |
| COSHC-UNIFRecall Strategy=Full Classification Prediction2022.03 | 7.2 | 17.7 | 24.1 | |
| UNIFRecall Strategy=Original2022.03 | 7.1 | 17.3 | 23.6 | |
| COSHC-UNIFRecall Strategy=w/o classification2022.03 | 7.1 | 17.4 | 23.6 | |
| COSHC-UNIFRecall Strategy=one classification2022.03 | 6.9 | 16.3 | 21.6 |