NL2Code Search on CoSQA (test)
55.77MRROASIS
Evaluation results
| Method | Links | |
|---|---|---|
| OASISModel Type=Open-source, Setting=zero-shot2025.03 | 55.77 | |
| Text-Embedding-3-LargeModel Type=Closed-source, Setting=zero-shot2025.03 | 55.38 | |
| CodeSage-largeModel Type=Open-source, Setting=zero-shot2025.03 | 47.53 | |
| OpenAI-ada-002Model Type=Closed-source, Setting=zero-shot2025.03 | 44.23 | |
| UnixCoderModel Type=Open-source, Setting=zero-shot2025.03 | 42.11 | |
| GraphCodeBERTModel Type=Open-source, Setting=zero-shot2025.03 | 16.2 | |
| CodeBERTModel Type=Open-source, Setting=zero-shot2025.03 | 0.24 |