Code Generation on NL2Bash
29.49Exact MatchTopK + LPR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TopK + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.05 | 29.49 | — | |
| DPP + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.05 | 28.96 | — | |
| Random + LPRBackbone=Llama-2-7B-Chat, Noise Type=Relevant Noise, Noise Ratio=60%2024.05 | 26.8 | — |