Code Search on Java (test)
36.1R@1COSHC-GraphCodeBERT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| COSHC-GraphCodeBERTRecall Strategy=ideal classification2022.03 | 36.1 | 58.5 | 64.9 | |
| GraphCodeBERTRecall Strategy=Original2022.03 | 35.3 | 57.1 | 64 | |
| COSHC-GraphCodeBERTRecall Strategy=Full Classification Prediction2022.03 | 35 | 56.1 | 62.5 | |
| COSHC-GraphCodeBERTRecall Strategy=w/o classification2022.03 | 34.7 | 55.3 | 61.6 | |
| COSHC-CodeBERTRecall Strategy=ideal classification2022.03 | 32.9 | 55.5 | 62.7 | |
| COSHC-GraphCodeBERTRecall Strategy=one classification2022.03 | 32.9 | 50.5 | 55.1 | |
| CodeBERTRecall Strategy=Original2022.03 | 31.9 | 53.2 | 60.8 | |
| COSHC-CodeBERTRecall Strategy=Full Classification Prediction2022.03 | 31.8 | 53.3 | 60.2 | |
| COSHC-CodeBERTRecall Strategy=w/o classification2022.03 | 31.6 | 52.7 | 59.3 | |
| COSHC-CodeBERTRecall Strategy=one classification2022.03 | 30.4 | 48.3 | 53.2 | |
| COSHC-CodeBERTaRecall Strategy=ideal classification2022.03 | 10 | 23.5 | 30.5 | |
| COSHC-UNIFRecall Strategy=ideal classification2022.03 | 9.3 | 22.2 | 29.6 | |
| COSHC-CodeBERTaRecall Strategy=Full Classification Prediction2022.03 | 9 | 21 | 27.2 | |
| CodeBERTaRecall Strategy=Original2022.03 | 8.9 | 20.3 | 26.4 | |
| COSHC-CodeBERTaRecall Strategy=w/o classification2022.03 | 8.9 | 20.1 | 25.8 | |
| COSHC-UNIFRecall Strategy=Full Classification Prediction2022.03 | 8.6 | 19.8 | 26.4 | |
| COSHC-UNIFRecall Strategy=w/o classification2022.03 | 8.5 | 19.3 | 25.4 | |
| COSHC-CodeBERTaRecall Strategy=one classification2022.03 | 8.5 | 18.9 | 23.8 | |
| UNIFRecall Strategy=Original2022.03 | 8.4 | 19.3 | 25.4 | |
| COSHC-RNNRecall Strategy=ideal classification2022.03 | 8.4 | 22.1 | 30.2 | |
| COSHC-UNIFRecall Strategy=one classification2022.03 | 8.3 | 18.3 | 23.6 | |
| COSHC-RNNRecall Strategy=Full Classification Prediction2022.03 | 7.6 | 19.4 | 26.5 | |
| COSHC-RNNRecall Strategy=w/o classification2022.03 | 7.4 | 18.6 | 25.3 | |
| RNNRecall Strategy=Original2022.03 | 7.3 | 18.4 | 25 | |
| COSHC-RNNRecall Strategy=one classification2022.03 | 7.3 | 18.2 | 24 |