NL2Code Search on Adv (test)
57.27MRROASIS
Evaluation results
| Method | Links | |
|---|---|---|
| OASISModel Type=Open-source, Setting=zero-shot2025.03 | 57.27 | |
| CodeSage-largeModel Type=Open-source, Setting=zero-shot2025.03 | 52.67 | |
| Text-Embedding-3-LargeModel Type=Closed-source, Setting=zero-shot2025.03 | 46.84 | |
| OpenAI-ada-002Model Type=Closed-source, Setting=zero-shot2025.03 | 38.08 | |
| UnixCoderModel Type=Open-source, Setting=zero-shot2025.03 | 27.32 | |
| GraphCodeBERTModel Type=Open-source, Setting=zero-shot2025.03 | 5.58 | |
| CodeBERTModel Type=Open-source, Setting=zero-shot2025.03 | 0.06 |