Code2Code Search on Code2Code Search (test)
66.27PythonOASIS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OASISzero-shot=true, model_type=Open-source2025.03 | 66.27 | 37.26 | 47.71 | 51.15 | 22.18 | 49.38 | 58.6 | 64.06 | 34.18 | 47.87 | |
| CodeSage-largezero-shot=true, model_type=Open-source2025.03 | 46.7 | 33.13 | 37.16 | 41.18 | 16.81 | 32.89 | 54.12 | 52.13 | 32.48 | 38.51 | |
| Text-Embedding-3-Largezero-shot=true, model_type=Closed-source2025.03 | 41.51 | 25.75 | 22.4 | 22.45 | 11.56 | 32.82 | 41.7 | 43.47 | 21.57 | 29.25 | |
| OpenAI-ada-002zero-shot=true, model_type=Closed-source2025.03 | 35.91 | 25.13 | 19.01 | 21.86 | 10.17 | 29.15 | 40.85 | 40.47 | 23.43 | 27.33 | |
| UnixCoderzero-shot=true, model_type=Open-source2025.03 | 30.77 | 16.45 | 21.32 | 21.95 | 6.19 | 15.62 | 32.33 | 31.93 | 13.94 | 21.17 | |
| GraphCodeBERTzero-shot=true, model_type=Open-source2025.03 | 19.23 | 10.78 | 7.38 | 8.65 | 5.54 | 8.48 | 19.69 | 15.67 | 9.65 | 11.68 | |
| CodeBERTzero-shot=true, model_type=Open-source2025.03 | 14.4 | 7.62 | 5.47 | 6.05 | 3.66 | 5.53 | 13.55 | 10.28 | 6.27 | 8.09 |