ResearchBenchmarksNL to LTL translation on 182 NL tasks distribution DNL to LTL translation on 182 NL tasks distribution DFollow88Success RateCMAS52.151261.458170.76580.0719Apr 22, 2025Evaluation resultsMethodMethodLinksSuccess RateCMASSetting=single-robot (...Setting=single-robot (N = 1)2025.0488UA-NL2LTLPrimary model=GPT 4oPrimary model=GPT 4o2025.0487.4Lang2LTLFew-shot=trueFew-shot=true2025.0482.87nl2specUser-in-the-loop=false...User-in-the-loop=false (disabled for fair comparison)2025.0473.16Lang2LTLFew-shot=falseFew-shot=false2025.0453.53