Constrained Decoding on LogicBench
98.5Constraint SatisfactionMetaJuLS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MetaJuLSBackbone=Llama-2-7B, Speculative Decoding=true2025.12 | 98.5 | 79.5 | 67 | |
| MetaJuLSBackbone=Llama-2-7B, Speculative Decoding=false2025.12 | 98.2 | 79.4 | 79 | |
| OutlinesBackbone=Llama-2-7B2025.12 | 97.1 | 78.8 | 125 | |
| LMQLBackbone=Llama-2-7B2025.12 | 96.5 | 78.5 | 134 | |
| NeuroLogicBackbone=Llama-2-7B2025.12 | 96.2 | 79.1 | 158 | |
| Speculative DecodingBackbone=Llama-2-7B, Condition=Only Speculative Decoding2025.12 | 94.1 | 78.3 | 142 | |
| BaselineBackbone=Llama-2-7B, Condition=Neither Speculative Decoding nor MetaJuLS2025.12 | 92.3 | 77.8 | 168 |