# AutoDSL: Automated domain-specific language design for structural representation of procedures with constraints

Source: [AutoDSL: Automated domain-specific language design for structural representation of procedures with constraints](<https://www.sota2.com/research/paper/68fa75761e209131cea681e9>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-02T07:49:10.899Z

Authors: Yu-Zhe Shi, Haofei Hou, Zhangqian Bi, Fanxu Meng, Xiang Wei, Lecheng Ruan, Qining Wang

Published: 2024-06-18T06:49:43.000Z

## Abstract

Accurate representation of procedures in restricted scenarios, such as non-standardized scientific experiments, requires precise depiction of constraints. Unfortunately, Domain-specific Language (DSL), as an effective tool to express constraints structurally, often requires case-by-case hand-crafting, necessitating customized, labor-intensive efforts. To overcome this challenge, we introduce the AutoDSL framework to automate DSL-based constraint design across various domains. Utilizing domain specified experimental protocol corpora, AutoDSL optimizes syntactic constraints and abstracts semantic constraints. Quantitative and qualitative analyses of the DSLs designed by AutoDSL across five distinct domains highlight its potential as an auxiliary module for language models, aiming to improve procedural planning and execution.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [DSL Evaluation on BioCoder](<https://www.sota2.com/research/sota/dsl-evaluation-on-biocoder.md>): DSL Evaluation; BioCoder; Opinion Score: 4.35.

- [DSL Evaluation on InfoBio](<https://www.sota2.com/research/sota/dsl-evaluation-on-infobio.md>): DSL Evaluation; InfoBio; Opinion Score: 4.38.

- [DSL Evaluation on Ecology](<https://www.sota2.com/research/sota/dsl-evaluation-on-ecology.md>): DSL Evaluation; Ecology; Opinion Score: 4.39.

- [DSL Evaluation on BioEng](<https://www.sota2.com/research/sota/dsl-evaluation-on-bioeng.md>): DSL Evaluation; BioEng; Opinion Score: 4.41.

- [DSL Evaluation on Medical](<https://www.sota2.com/research/sota/dsl-evaluation-on-medical.md>): DSL Evaluation; medical; Opinion: 4.4.

- [DSL Evaluation on Genetics](<https://www.sota2.com/research/sota/dsl-evaluation-on-genetics.md>): DSL Evaluation; Genetics; Opinion: 4.41.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2406.12324>)

[PDF](<https://arxiv.org/pdf/2406.12324.pdf>)

[Implementation](<https://autodsl.org/procedure/papers/acl24shi.html>)
