NL2DSL on F2nl-1K (test)
72Similarity ScoreMistral7B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Mistral7BTrain Data=68K, Example RAG=0, Test RAG=02026.04 | 72 | 3.9 | |
| Mistral7BTrain Data=68K, Example RAG=5, Test RAG=52026.04 | 72 | 1.9 | |
| Mistral7BTrain Data=68K, Example RAG=3, Test RAG=32026.04 | 72 | 1.8 | |
| Phi-3-mediumTrain Data=68K, Example RAG=5, Test RAG=52026.04 | 72 | 3.1 | |
| Mistral7BTrain Data=68K, Example RAG=5, Test RAG=02026.04 | 71 | 1.5 | |
| Mistral7BTrain Data=68K, Example RAG=3, Test RAG=02026.04 | 71 | 1.4 | |
| NeMo-mistralTrain Data=68K, Example RAG=3, Test RAG=02026.04 | 71 | 1.9 | |
| NeMo-mistralTrain Data=68K, Example RAG=3, Test RAG=32026.04 | 71 | 2.2 | |
| Gpt-4o-miniTrain Data=68K, Example RAG=5, Test RAG=52026.04 | 71 | 2.6 | |
| GPT4-RAGTrain Data=68K, Example RAG=5, Test RAG=52026.04 | 70 | 2.1 | |
| Code Cushman 2Train Data=68K, Example RAG=0, Test RAG=02026.04 | 70 | 3.8 |