ResearchBenchmarksNatural Language to Bash on NL2Bash (test)Natural Language to Bash on NL2Bash (test)Follow58.5BLEU-4 (char)MBR-EXEC52.57254.11155.6557.189Apr 25, 2022Evaluation resultsMethodMethodLinksBLEU-4 (char)MBR-EXECtemperature=0.3, numbe...temperature=0.3, number of samples=25, selection process=execution-based2022.0458.5Sampleshot=3-shot, temperatu...shot=3-shot, temperature=0.3, number of samples=1252022.0453Greedyshot=3-shot, number of...shot=3-shot, number of samples=1252022.0452.8